-- Logs begin at Thu 2022-09-08 13:02:28 UTC, end at Thu 2022-09-08 14:29:41 UTC. -- Sep 08 13:44:25.288193 dv-cinder-820027-24-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 13:44:25.295766 dv-cinder-820027-24-smb devstack@keystone.service[81755]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:44:25 2022] *** Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: nodename: dv-cinder-820027-24-smb Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: machine: x86_64 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: clock source: unix Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: pcre jit disabled Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: detected number of CPU cores: 4 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: current working directory: / Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: your processes number limit is 47680 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: your memory page size is 4096 bytes Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: detected max file descriptor number: 2048 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: lock engine: pthread robust mutexes Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: thunder lock: enabled Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 13:44:25.301501 dv-cinder-820027-24-smb devstack@keystone.service[81755]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:44:25.339842 dv-cinder-820027-24-smb devstack@keystone.service[81755]: Python main interpreter initialized at 0x5636deabd9c0 Sep 08 13:44:25.339842 dv-cinder-820027-24-smb devstack@keystone.service[81755]: python threads support enabled Sep 08 13:44:25.339842 dv-cinder-820027-24-smb devstack@keystone.service[81755]: your server socket listen backlog is limited to 100 connections Sep 08 13:44:25.339842 dv-cinder-820027-24-smb devstack@keystone.service[81755]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:44:25.340226 dv-cinder-820027-24-smb devstack@keystone.service[81755]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:44:25.340304 dv-cinder-820027-24-smb devstack@keystone.service[81755]: *** Operational MODE: preforking *** Sep 08 13:44:25.340568 dv-cinder-820027-24-smb devstack@keystone.service[81755]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:44:25.340568 dv-cinder-820027-24-smb devstack@keystone.service[81755]: spawned uWSGI master process (pid: 81755) Sep 08 13:44:25.340787 dv-cinder-820027-24-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 13:44:25.341476 dv-cinder-820027-24-smb devstack@keystone.service[81755]: spawned uWSGI worker 1 (pid: 81765, cores: 1) Sep 08 13:44:25.341747 dv-cinder-820027-24-smb devstack@keystone.service[81755]: spawned uWSGI worker 2 (pid: 81766, cores: 1) Sep 08 13:44:25.341900 dv-cinder-820027-24-smb devstack@keystone.service[81755]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:44:29.812538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:44:29.812538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: from cryptography.utils import int_from_bytes Sep 08 13:44:29.813349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:44:29.813349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: from cryptography.utils import int_from_bytes Sep 08 13:44:29.814457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:44:29.814457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Sep 08 13:44:29.814978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:44:29.814978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Sep 08 13:44:29.866018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:44:29.866296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:44:29.866430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] command line args: [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:44:29.866663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:44:29.866847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ================================================================================ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:44:29.867109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] admin_token = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.867242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:44:29.867362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:44:29.867487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_dir = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.867601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] command line args: [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:44:29.867723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.867723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] config_source = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.867959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:44:29.868089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] debug = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.868214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ================================================================================ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:44:29.868398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.868754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.868754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_dir = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_source = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.869851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] debug = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_config_append = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.870903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_dir = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.871889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_config_append = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_dir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.872954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.873802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.874985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.875883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] publish_errors = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] publish_errors = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.876945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] standard_threads = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.877952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] standard_threads = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_journal = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_json = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.878895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_stderr = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] use_syslog = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_journal = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_json = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.879772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.879895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_stderr = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.880019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.880134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_syslog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.880265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.880398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:44:29.880556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.880556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.880794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.880920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.881895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.882951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.883915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.884988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.885907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.886974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.887905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.888989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.889990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.890950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.891900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.892944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.893622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.893741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.893873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.894887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.895956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.896808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.897880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.898003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.898140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.898282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.898420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.899918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.900992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.901892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.902945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.903883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.904913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.905943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.906876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.external = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.907867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.908001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.908127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.908127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.password = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.909553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.909690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] auth.token = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.909842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.external = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.909842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.910064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.910064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.910713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.910851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.910997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.password = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.token = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.911978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.912920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.913902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.914933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.915963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.916883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.917909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.918951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.919993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.920891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.921967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.922930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.923911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.924028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.924144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.924804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.924888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.924968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.925996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.926994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.927889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.928842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.929945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.930902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.931910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.932918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.933975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.934937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.935993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.936971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.937891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.938964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.939892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.940927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.941948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.942997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.943967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.944971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.945904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.946941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.947963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.948971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.949983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.950970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.951805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.952987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.953914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.954973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.955102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.955226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.955344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.955461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.956956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81765) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:44:29.957257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.957897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:44:29.958074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:44:29.987398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.987639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.987872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.992020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.992256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.992491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:29.996576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.001061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.026016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.026234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.028662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.028902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.083313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.087530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.133497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.133721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.134788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.134788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.293752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.293987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.294207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.294432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.294653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.294874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.296290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.296725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.297136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.297539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.297946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.298346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.319693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.319932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.320924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.321015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.321092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.321165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.321285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.321508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.334644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.337256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.351566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.351787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.351899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.351986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.352134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.352222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.352437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.352869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.353262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.353432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.353664 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.353749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.353898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.354129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81765) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:44:30.372067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.372263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:44:30.372634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.372749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.372858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:44:30.372944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:44:30.373140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.373225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.373402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:44:30.373503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.373667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.373749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.373933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.374015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.374199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.374462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.384553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.384848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.385123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.385337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.385445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.385628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.385903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.386191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.392458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.393501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.396036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.396328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.396649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.396941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.397230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.397320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.397501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.397631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.397780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.397913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.398947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.399143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.399424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.399702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.399975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.422636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.424144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.424436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.424599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.426288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.426577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.429333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.429624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.429911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.432586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.433102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.433594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.436451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.436775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.442976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.443276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.443417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.443678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.443973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.444269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.444577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.444859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.445135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.445408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.447301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.447600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.447888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.448178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.450385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.450682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.450972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.451257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.461916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.462606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.466115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.467996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.468293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.469376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.469684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.472628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.474087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.475786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.476092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.477344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.480471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.480614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.480927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.481220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.481632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.481932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.482217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.483641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.486875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.487336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.487838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.488252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.488562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.488869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.498460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.498755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.499028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.499295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.505846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.506142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.506416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.506683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.506883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.508434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.510000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.510283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.513008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.513304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.513495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.513628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.513861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.515154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.515349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.516822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.517093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.521033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.521929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.521929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.521929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.522164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.532322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.532657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.532950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.533241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.534038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.534329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.534633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.534771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.535015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.535302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.535589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.535880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.536169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.536451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.550491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.553392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.553616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.556682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.558140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.558882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.559620 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.559911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.560325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.561900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.563360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.565666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.566148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.566754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.568402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.569951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.572908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.573319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.573611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.573889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.574044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.575368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.578297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.578594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.578885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.579169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.582779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.583084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.583372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.588336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.588627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.588927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.590420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81765) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.590717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.591006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.591291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.591574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.591854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.592139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.592430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.592770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.593361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.593513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.593772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.594055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.594335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81765) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.595951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:44:30.596282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.596710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.597328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.597531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.597814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.598094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.598386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.598660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.598936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.599221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.599503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.599775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.600050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:44:30.631176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636deabd9c0 pid: 81765 (default app) Sep 08 13:44:30.634741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fcf0-6cfd-4e55-a9e1-9ef6db4272c9 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:30.635033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fcf0-6cfd-4e55-a9e1-9ef6db4272c9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:30.635314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410fcf0-6cfd-4e55-a9e1-9ef6db4272c9 None None] PATH_INFO: `/v3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:30.636296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636deabd9c0 pid: 81766 (default app) Sep 08 13:44:30.639548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Thu Sep 8 13:44:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:39.376701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:39.377237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:39.377237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:39.381978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:39.387585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:39.388074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:39.388179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:39.460365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: INFO dbcounter [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] Registered counter for database keystone Sep 08 13:44:39.481671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG oslo_db.sqlalchemy.engines [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81765) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:44:39.488179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writer thread running {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:44:39.679593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG passlib.handlers.bcrypt [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81765) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:44:39.679893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG passlib.handlers.bcrypt [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81765) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:44:39.741138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:39.742763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:39.899601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 13:44:40.389409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:40.461578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: INFO dbcounter [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] Registered counter for database keystone Sep 08 13:44:40.482416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG oslo_db.sqlalchemy.engines [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:44:40.489935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writer thread running {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:44:40.618514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff5e55-0234-494e-a80a-ec670f5e4e8c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:40.622878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:40.623544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:40.623856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:40.624162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:40.633622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:40.688582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:44:40.688867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6ecaa-5c91-41c9-aae1-ba0bddb024de admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:40.699799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Sep 8 13:44:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:44:40.706206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:40.726613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30097-2058-48e3-b25b-c041fdb3760e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:40.731218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:40.732406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:40.732723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:40.733000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] PATH_INFO: `/v3/projects/61119233e1da4995af8ba7ce35ded1dd` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:40.734727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=61119233e1da4995af8ba7ce35ded1dd)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:40.789763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING keystone.common.rbac_enforcer.enforcer [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:44:40.790095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1694e-244e-41b3-a607-2aa4ea04f8c5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:40.794910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Thu Sep 8 13:44:40 2022] GET /identity/v3/projects/61119233e1da4995af8ba7ce35ded1dd => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:43.087914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f6097-10ea-485b-a221-5e0a1f79ee1c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.088439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f6097-10ea-485b-a221-5e0a1f79ee1c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.088439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f6097-10ea-485b-a221-5e0a1f79ee1c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.093057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:43.099597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.100112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.100270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.124670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:43.126316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:43.135157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 08 13:44:43.408121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f6097-10ea-485b-a221-5e0a1f79ee1c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:43.421685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f6097-10ea-485b-a221-5e0a1f79ee1c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:43.426660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:43.427281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.427583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.427842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.436672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:43.438486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe5564-be73-4cd2-a775-d8001d34d664 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:43.448400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Sep 8 13:44:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:44:43.454305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:43.467566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd4e3-e2f2-46d3-8386-570ad970401f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:43.472868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:43.473525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.473813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.474093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.475473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:43.477386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6876e3-2f16-478e-8e04-83eeb260cf4e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:43.479053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Thu Sep 8 13:44:43 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:45.843089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dc1f-9c56-4000-9b96-327797bf9ce1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:45.843824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dc1f-9c56-4000-9b96-327797bf9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:45.843824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dc1f-9c56-4000-9b96-327797bf9ce1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:45.845021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:45.851385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:45.851909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:45.852009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:45.870814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:45.872024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:45.913345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a892-f363-4c51-8686-f86b2be5d944 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:45.913650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a892-f363-4c51-8686-f86b2be5d944 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:45.913936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67a892-f363-4c51-8686-f86b2be5d944 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:45.915264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:45.921057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:45.921346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:45.921625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:45.964504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:44:45.967047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81766) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:44:45.967537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81766) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:44:46.017178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:46.019138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:46.127956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:44:46.240684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.265430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:46.354482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd1713-8ed0-462d-ac60-68980add11e9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:46.393358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:46.393883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.394169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.394450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.404067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.468464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:46.472290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:46.511602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:46.539635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a36e4-ceaa-4e04-9fb6-6fb92c2b39cc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:46.542291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:46.590915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:46.592065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.592356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.592674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.606432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:46.610755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:46.617460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:46.619936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:46.620899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:46.621758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:44:46.622432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:44:46.628679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.729068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147c8a4-dbb9-4b31-970a-540bff222716 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:46.742667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95c9a5-e4aa-48f4-8cd2-b6847e79642a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:46.756265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:46.771734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:46.775332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.775332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.775332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.790206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:46.790919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:46.791601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.791765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:46.792001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.792387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.793123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:46.793511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:46.795097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:46.809126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 9/16] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:46.815629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:44:46.816804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:46.817831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:44:46.818666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:44:46.818666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:44:46.818666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:44:46.819173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 8/17] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:44:46.828966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.845763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:46.922763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bfd9-fad1-43db-a4cf-12bfcf4cad74 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:46.963158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:46.963814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.964151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.964482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.966093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:46.968093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:46.969336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:46.975656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.989034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d707f2d-62f3-49b7-af9f-9e0aa3297bd7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:47.027265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:47.028001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:47.028418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:47.028855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:47.029638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:47.030035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:47.031589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:47.051005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:47.085019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:47.092777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa027e0-7d4d-48f8-b689-4214d09dc398 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:47.134657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:47.135600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:47.135936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:47.136213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:47.137559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:47.139069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18a14-f426-4727-bb3a-6c794916db4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:47.140766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:47.147843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:47.197190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:47.277021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053be89-85f5-4439-badf-ff48ed3779fb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:47.316136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:47.316917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:47.317210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:47.317492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:47.318258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.domain.id=default, user.id=1ba15123fbd2428d82b676fd494c4a7b) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:47.318564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:47.320192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d00553-b2ba-4378-9b43-e6485864f60a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:47.328035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Sep 8 13:44:47 2022] GET /identity/v3/role_assignments?user.id=1ba15123fbd2428d82b676fd494c4a7b&scope.domain.id=default&role.id=7344c45181b34c769b527731ca22627a => generated 233 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:50.347847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e111c1-a3c7-4697-aecb-8f60a907db4f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.348737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e111c1-a3c7-4697-aecb-8f60a907db4f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.349181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e111c1-a3c7-4697-aecb-8f60a907db4f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.350685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:50.359218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae796-a478-4433-8004-e47b172c7262 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.359967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae796-a478-4433-8004-e47b172c7262 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.360102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae796-a478-4433-8004-e47b172c7262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.398304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-939ae796-a478-4433-8004-e47b172c7262 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:50.400199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-939ae796-a478-4433-8004-e47b172c7262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:50.567225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:50.804307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecbaf-a372-4fb9-8d82-498fa354043c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.804900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecbaf-a372-4fb9-8d82-498fa354043c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.805330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecbaf-a372-4fb9-8d82-498fa354043c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.806897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:50.813013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149f67-1179-44da-b3cd-60f22d86814b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.813527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149f67-1179-44da-b3cd-60f22d86814b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.813974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da149f67-1179-44da-b3cd-60f22d86814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.853857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-da149f67-1179-44da-b3cd-60f22d86814b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:50.855362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-da149f67-1179-44da-b3cd-60f22d86814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:50.888825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:50.967108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:44:50.974866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d213-9992-4505-bac1-b09cffa82b8f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.975369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d213-9992-4505-bac1-b09cffa82b8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.975815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d213-9992-4505-bac1-b09cffa82b8f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.977369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 14/26] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:50.998611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.999153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.999574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.027152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:51.028655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:51.039395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391791f-b9ee-42d5-9dc3-a5f4909d5502 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.039907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391791f-b9ee-42d5-9dc3-a5f4909d5502 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.040333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391791f-b9ee-42d5-9dc3-a5f4909d5502 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.041878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 15/27] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:51.050853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.051352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.051775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.083102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:51.084741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:51.209440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 13/28] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:51.234390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:51.288487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 16/29] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:44:51.444499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:51.480172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:51.515498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c552-27b8-4344-b28a-9a6f2ed94939 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:51.682133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:51.683226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.683751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.684264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.692269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:51.697856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:51.732187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:51.742956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba7a83-0786-4656-b3a0-3a64e6864c8c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:51.787676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:51.788330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.788669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.788951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.800245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:51.805260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:51.807050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 17/30] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:44:51.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:51.974696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7be94-7f89-4655-9e51-b3453b4b474e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.012564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 14/31] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Sep 8 13:44:51 2022] POST /identity/v3/roles => generated 219 bytes in 774 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:44:52.012564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.024722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.025659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.026128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.026578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.027666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.029584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d98c0-4273-43be-a71d-fce7095cbf97 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.211729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584473c-5dcf-4967-ae84-484ea916589d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.255315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.255972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.256256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.256557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.259670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 18/32] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Sep 8 13:44:51 2022] POST /identity/v3/roles => generated 225 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:44:52.261117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96ae6-6143-4188-9890-3fa85e06f87d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.261446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96ae6-6143-4188-9890-3fa85e06f87d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.261725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96ae6-6143-4188-9890-3fa85e06f87d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.263341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 19/33] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:52.264127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba96ae6-6143-4188-9890-3fa85e06f87d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.270974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.274670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.282837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.292711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bd42707e-5639-4c9e-8b69-080bbaa3cef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:44:52.306281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:52.307238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:44:52.308047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:44:52.308047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:44:52.308047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:44:52.308844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 15/34] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:44:52.319449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561420a-cf1b-4999-a3b6-60f71042c8f1 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.319960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561420a-cf1b-4999-a3b6-60f71042c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.320450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561420a-cf1b-4999-a3b6-60f71042c8f1 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.325935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 16/35] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:52.325935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.325935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.326255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.349906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:52.351601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:52.423240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba96ae6-6143-4188-9890-3fa85e06f87d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.450646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 17/36] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:52.451961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.479318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.480260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.480763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.481218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.482389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:52.482892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.485796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8f817-6eed-4d2e-88fd-abefc587c0b3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.504130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 20/37] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:52.508622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.508622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.508622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.528693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:52.530432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:52.621615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24040b1-5b73-49e8-bf3c-838216bfac20 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.627010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 21/38] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:52.627804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.632072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.666941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.673671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.675215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.675704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.676554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.677420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:52.677902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.680094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.705887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 18/39] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:52.711805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.774615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc69d72-439e-40c8-beae-6e7c455d1da3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.829194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.829849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.830135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.830967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.832130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.833627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.835457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 22/40] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:52 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:52.836211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.861096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d2df-837c-4641-a63c-2036a272504f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.899887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.900696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.901075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.901469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.902213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.903864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.947634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.997789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28068f-7c28-4a6f-97a6-70ed5f03a359 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:53.040370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 19/41] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:44:52 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:44:53.041867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:53.046469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:53.047112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:53.047396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:53.047673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:53.048379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:53.049946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:53.110985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:53.180299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2962da-4017-4f8d-8594-d1e713092f47 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:53.197544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 23/42] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Sep 8 13:44:52 2022] POST /identity/v3/roles => generated 223 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:44:53.199656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:53.346939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:53.351603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:53.352063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:53.352529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:53.354075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:53.355893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:53.357650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 20/43] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:53.363924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:53.409878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a4aa2-cb17-4cb8-86ac-7b7ff3123779 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:53.454676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:53.463049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:53.464024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:53.464469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:53.464991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:53.466909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:53.472824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:53.473088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 24/44] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:53.482330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:53.503442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b57fe1-a24e-442e-91db-c2d6d5fde01e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:53.521485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:53.553555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:53.554613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:53.555071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:53.555531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] PATH_INFO: `/v3/domains/default/users/1ba15123fbd2428d82b676fd494c4a7b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:53.558496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ba15123fbd2428d82b676fd494c4a7b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:53.561038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25492eb5-ce33-424f-ad11-0501eaf018aa None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:53.609682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d438875-6e37-4aef-ac8b-c7d99aeeedcd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:53.644979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:53.645611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:53.645894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:53.646169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:53.646841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:53.648296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebcb9c-0852-4b79-8f7e-d97c84cb3799 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:53.696871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 21/45] 10.222.0.33 () {58 vars in 1361 bytes} [Thu Sep 8 13:44:53 2022] PUT /identity/v3/domains/default/users/1ba15123fbd2428d82b676fd494c4a7b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:44:53.793666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 25/46] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:44:53 2022] POST /identity/v3/projects => generated 312 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:44:55.919593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0719-a011-4974-9b35-d8fbc7099bb7 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:55.920219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0719-a011-4974-9b35-d8fbc7099bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:55.920219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0719-a011-4974-9b35-d8fbc7099bb7 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:55.921712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 22/47] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:55.927713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2d3a-1354-4866-8a01-68b5462478a9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:55.928186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2d3a-1354-4866-8a01-68b5462478a9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:55.928265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2d3a-1354-4866-8a01-68b5462478a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:55.947597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-463a2d3a-1354-4866-8a01-68b5462478a9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:55.948821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-463a2d3a-1354-4866-8a01-68b5462478a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:56.008008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:56.028933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:56.094745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dafd2-b68e-46c2-bcac-8c0553f542b7 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.095034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dafd2-b68e-46c2-bcac-8c0553f542b7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.095319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dafd2-b68e-46c2-bcac-8c0553f542b7 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.097084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 23/49] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:56.102581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.102870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.103150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.122658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:56.127278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:56.196255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 27/50] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:44:56.303994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dafd2-b68e-46c2-bcac-8c0553f542b7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:56.469356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dafd2-b68e-46c2-bcac-8c0553f542b7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:56.475218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:56.535408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:56.536451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.537000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.537511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.559059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:56.572188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:56.573720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:44:56.574694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 24/51] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:44:56.582361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8c7c-6c68-49fd-826d-9a50372d1119 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:56.586177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:56.601217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:56.624767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:56.626596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:56.627572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.628574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.628574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.629613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:56.631635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:56.633818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 28/52] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:56.639554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:56.719124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62060b9-05b2-45ed-9dce-66fe99a53b63 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:56.753925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e159-28f9-4ff8-9a48-28b1dd47ea07 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:56.760783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:56.760783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.760783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.761331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.761763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:56.762068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:56.764211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:56.783835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:56.786389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:56.800241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:56.801232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.801703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.802937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.804126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:56.806944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:56.895461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:56.904112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98e420-b4ed-470e-a8b5-fa95f2a2b3bb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:56.942334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:56.943367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.943367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.943864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.945127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:56.946615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:56.948314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 26/54] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:56 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:56.951199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 29/55] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Sep 8 13:44:56 2022] POST /identity/v3/projects => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:44:56.957337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:57.086225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223cef0-6c30-461e-8453-f381eb37d561 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:57.126817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:57.128223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:57.128774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:57.129077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:57.130378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:57.131897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc029452-82c2-4503-b257-00cc5d2b58fb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:57.133891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 27/56] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:57.139971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:57.179624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:57.259332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4651624-9a18-4602-9264-b48ac9ecfeea None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:57.308208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:57.309323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:57.309821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:57.310320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:57.311710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.domain.id=default, user.id=1ba15123fbd2428d82b676fd494c4a7b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:57.312269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:57.315670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aba59-be76-4cc4-aee7-1af1c4feedc3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:57.344642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 30/57] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Sep 8 13:44:57 2022] GET /identity/v3/role_assignments?user.id=1ba15123fbd2428d82b676fd494c4a7b&scope.domain.id=default&role.id=7344c45181b34c769b527731ca22627a => generated 530 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:59.215629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beeac6-561a-4ec7-a12b-1aa0ee85c00b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:59.216181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beeac6-561a-4ec7-a12b-1aa0ee85c00b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:59.216181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92beeac6-561a-4ec7-a12b-1aa0ee85c00b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:59.217654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 28/58] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:59.223921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:59.224386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:59.224486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:59.349271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:59.350521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:59.419682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:44:59.699388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beeac6-561a-4ec7-a12b-1aa0ee85c00b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:59.728683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:59.808373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92beeac6-561a-4ec7-a12b-1aa0ee85c00b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:59.849884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:59.850550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:59.850838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:59.851116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:59.852354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:59.853872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f2978-c2e0-49dd-a5b1-3211990d7688 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:59.855518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 29/60] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:59.861838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:59.889105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:59.969535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601634-975a-4576-bfeb-d452397bae21 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:00.007289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:00.007915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:00.008205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:00.008490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:00.009179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:00.010655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def1036-9b8c-4b8a-a9b3-6e87915a398f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:00.157105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 32/61] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:44:59 2022] POST /identity/v3/users => generated 275 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:03.905812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716954-ae72-45bd-b2de-e943675c925f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:03.906605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716954-ae72-45bd-b2de-e943675c925f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:03.906605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716954-ae72-45bd-b2de-e943675c925f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:03.907706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 30/62] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:03.913770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c8ba8-f694-4987-8267-f87b059b39c4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:03.914524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c8ba8-f694-4987-8267-f87b059b39c4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:03.914524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c8ba8-f694-4987-8267-f87b059b39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:03.957750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7a9c8ba8-f694-4987-8267-f87b059b39c4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:03.960455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7a9c8ba8-f694-4987-8267-f87b059b39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:04.074890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:04.148295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206ae4-6784-47f1-8b54-6eec0bb1c953 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.148992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206ae4-6784-47f1-8b54-6eec0bb1c953 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.149470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4206ae4-6784-47f1-8b54-6eec0bb1c953 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.151150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 31/64] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:04.157254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb47b7-6745-4c0a-96ce-c57ec31774f6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.157510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb47b7-6745-4c0a-96ce-c57ec31774f6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.157759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb47b7-6745-4c0a-96ce-c57ec31774f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.188902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c3bb47b7-6745-4c0a-96ce-c57ec31774f6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:04.190448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c3bb47b7-6745-4c0a-96ce-c57ec31774f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:04.199469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:04.219435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8ab4-5b10-414c-9591-dde6d7952eb2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.220097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8ab4-5b10-414c-9591-dde6d7952eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.220630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a8ab4-5b10-414c-9591-dde6d7952eb2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.223681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 32/65] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:04.234711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.235352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.235837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.266340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:04.268629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:04.306461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 34/66] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:04.387323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 33/67] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:04.438750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50a6c-32a2-4979-a9db-14faee3ed5a3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.439369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50a6c-32a2-4979-a9db-14faee3ed5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.440400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d50a6c-32a2-4979-a9db-14faee3ed5a3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.442162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 35/68] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:04.452241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:04.457435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.457939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.458390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.498313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:04.500405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:04.509045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:04.645116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f1ed2-4089-469b-930b-6a264c9d3fd5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:04.661751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 36/69] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:04.662847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:04.704761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:04.707390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.707843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.709389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.732790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:04.739326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:04.740416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:04.741439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:04.758990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 34/70] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:04.774277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:04.801246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:04.828626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8de32-ae5a-4c4d-ac28-2ce25edebbf9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:04.866822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:04.867741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:04.868236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:04.868708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:04.881833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:04.889140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:04.890239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:04.891165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:04.893901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 37/71] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:04.899944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.003506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.024816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9474-67b5-430f-853a-2a4fa8ec0e68 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.055165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21fb4-bf6e-42aa-a14f-4c9c238fbb89 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.070824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.071499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.071990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.072281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.073548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:05.073865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.075852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.094210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 35/72] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.095273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.096463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.103136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720422-8074-4716-b118-71e1506faff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.104147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720422-8074-4716-b118-71e1506faff8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.104680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720422-8074-4716-b118-71e1506faff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.105149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63720422-8074-4716-b118-71e1506faff8 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.106041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63720422-8074-4716-b118-71e1506faff8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:05.106647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63720422-8074-4716-b118-71e1506faff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.108220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63720422-8074-4716-b118-71e1506faff8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.118952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 38/73] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.120071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720422-8074-4716-b118-71e1506faff8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.228388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce66eb-916f-434a-ba0b-5c5283a4b2df None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.240272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63720422-8074-4716-b118-71e1506faff8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.265161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.265825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.266110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.266390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.278538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:05.278985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.279647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.279935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.280218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:05.284121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:05.285552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:05.286339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 36/74] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:05.286975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.294954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:05.299555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:05.300908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:05.301974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:05.302783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 39/75] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:05.303630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.367122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.402007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606ccb-da6a-430e-a624-863d42a3e0d1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.427530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b5682-53a5-4135-ba28-f1ed6b1afa99 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.450563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.451205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.451487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.451766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.466248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.468137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c64765-cca6-4592-a946-38df2a884e7f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.469187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.470036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.476431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 37/76] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.476767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.476767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.476995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d1a-86b8-4dd1-925b-e783def4f7b6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.476995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d1a-86b8-4dd1-925b-e783def4f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.477131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.477198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7d1a-86b8-4dd1-925b-e783def4f7b6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.477262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.477334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 38/77] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:05.477334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b7d1a-86b8-4dd1-925b-e783def4f7b6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.477456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 40/78] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.478113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.557300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.598089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d364-6f3d-48cd-bbf6-6c49b277a49f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.599042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b7d1a-86b8-4dd1-925b-e783def4f7b6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.623421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.636114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.636775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.637068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.640662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.640662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:05.640662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.640662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.641158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.641158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.641158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.641158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.641737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:05.642046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.644062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40979-d9fa-431e-8f9b-6401dd7d6373 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.650702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 41/79] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.651551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.662939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 39/80] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:05.662939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.662939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.662939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.678956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:05.680189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:05.749727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 40/81] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:05.750903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.771833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc608e-a32f-4e59-be42-458206b15a51 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.814190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.815430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.815913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.816390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.819934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.882727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae9e18-efba-4ac4-9575-2f7f601797a5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.883248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.901136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:05.902650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:05.921000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:05.921619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.921911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.922191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.016552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.018169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.046910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 42/82] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:06.047795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.082651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.129971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 41/83] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:06.130857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.141459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.162877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968ac2b-8f0c-4c76-9759-a8a8bd2091a7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.199832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.200489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.200809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.201147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.202339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.203842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.205619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 43/84] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:06.206427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.240303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd15b6-2bc6-45d2-bfec-dbad76352aae None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.280551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.281229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.281514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.281790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.282997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.285614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.287287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 42/85] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:06.288072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.322663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.337336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd54d95-5d44-4b56-8e9a-d17214c8e32e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.379009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.379671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.379959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.380238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.381455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.382934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.384617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 44/86] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:06.385449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.414583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.426597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492fe4f-9b57-4a69-be5a-c055baac5f94 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.479162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.479825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.480110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.480388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.481621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.483124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.485075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 43/87] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:06.485654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.524596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72f35-de76-41e8-afe1-585d2b537510 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.564571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.566024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.566317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.566597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.567889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.569412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.571139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 45/88] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:06.571940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.595127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.601907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945f1cd-2eda-4c9e-8f5f-8bfccad11fc0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.639416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.640063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.640355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.640668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.667457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.680258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23da00-787d-4bd8-9c22-46da173b098b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:06.721968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.722466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.722602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.722877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.723153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.737665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.816559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.818128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.851341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.859663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 44/89] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:06.862437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.916262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.931964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 46/90] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:06.932878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:06.983243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66513-59d2-47af-ab28-99088c1ee320 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.020593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.021369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.021483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.021768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.022445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.023926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.047693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4656ffc-4aae-41ef-8995-bb083029cc6f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.094605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.095236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.095515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.095844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.096689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:07.096891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.098375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.119723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 47/91] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:06 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=f500e18e097649cf98678fa3334fb969 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:07.119723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:07.128988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 45/92] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:06 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:07.129981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:07.201312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:07.213310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:07.293726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc0430-1b46-46d1-ba05-f1095b3f6c9c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.297765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2c9e-d661-42ad-b218-3f8849c5c91c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.346446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.347772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.348251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.348851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] PATH_INFO: `/v3/projects/1e6b3024dd644b3dbca8e2e144b46258` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.350466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] RBAC: Authorizing `identity:get_project(project_id=1e6b3024dd644b3dbca8e2e144b46258)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.352437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.354516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 46/93] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:07 2022] GET /identity/v3/projects/1e6b3024dd644b3dbca8e2e144b46258 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:07.355719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:07.357982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.358636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.358926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.359208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.362530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=1ba15123fbd2428d82b676fd494c4a7b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:07.362958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.364538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.375225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 48/94] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:07 2022] GET /identity/v3/role_assignments?user.id=1ba15123fbd2428d82b676fd494c4a7b&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:07.376364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:07.505421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed74e-2aa2-4640-aade-0b3a75932d25 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.530007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:07.551234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042545c-142e-4b9a-a329-cee75fb90766 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.553089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.553954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.554306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.554654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.556577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.559549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.563251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 47/95] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:07 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:07.572944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:07.579596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:07.609786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.610800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.611231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.611714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.616288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=1e6b3024dd644b3dbca8e2e144b46258, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:07.617001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.618628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aee739-3b78-4221-b0af-3e33b6b4a1b6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.631522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 49/96] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:07 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=1e6b3024dd644b3dbca8e2e144b46258&role.id=f500e18e097649cf98678fa3334fb969 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:07.767470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cc18f-26f8-4d0d-8b2b-6ecd87b8816a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:07.823087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:07.823722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:07.824009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:07.824291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:07.825076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:07.825392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:07.826895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa964085-29bb-4746-9306-f3f954b64caf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:07.837404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 48/97] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:07 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:10.472861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d36-b0ca-4140-ae4e-cd9ecb8680ba None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:10.474447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d36-b0ca-4140-ae4e-cd9ecb8680ba None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:10.475223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e59d36-b0ca-4140-ae4e-cd9ecb8680ba None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:10.478049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 50/98] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:10.486784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:10.488285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:10.489143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:10.521464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:10.523875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:10.529879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1005-eacc-4fcf-bf51-1bf9a0d92b0c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:10.530773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1005-eacc-4fcf-bf51-1bf9a0d92b0c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:10.531554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1005-eacc-4fcf-bf51-1bf9a0d92b0c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:10.535189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 51/99] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:10.545532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76033b-e0b1-45cf-bcb2-8e630e991703 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:10.546452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76033b-e0b1-45cf-bcb2-8e630e991703 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:10.547222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76033b-e0b1-45cf-bcb2-8e630e991703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:10.605767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7a76033b-e0b1-45cf-bcb2-8e630e991703 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:10.607157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7a76033b-e0b1-45cf-bcb2-8e630e991703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:10.741278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:10.801903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 49/100] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:10.814222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 52/101] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:11.314269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:11.340596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b636-af70-4801-ba22-fbe7730420aa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.341226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b636-af70-4801-ba22-fbe7730420aa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.342316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b636-af70-4801-ba22-fbe7730420aa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.346066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 53/102] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:11.351208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01380-5d01-412f-92e1-b6e63c82cb89 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.351864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01380-5d01-412f-92e1-b6e63c82cb89 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.352342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01380-5d01-412f-92e1-b6e63c82cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.391045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1aa01380-5d01-412f-92e1-b6e63c82cb89 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:11.395038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1aa01380-5d01-412f-92e1-b6e63c82cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:11.521562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4eef7-53c5-4fdc-87ca-4c60502c77e2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:11.568572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 54/103] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:11.570488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955bc1-62a0-468d-8b90-03f569bcc6a7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.571061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955bc1-62a0-468d-8b90-03f569bcc6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.571364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955bc1-62a0-468d-8b90-03f569bcc6a7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.573344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 55/104] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:11.574125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955bc1-62a0-468d-8b90-03f569bcc6a7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:11.608820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:11.609487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.609774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.610058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.632159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-f7d2d8dd-115d-4c1c-aa97-5b4bf67c899a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:11.637199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:11.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:11.639533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 50/105] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:11.640839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.641132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.641418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.662911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:11.664165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:11.694775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:11.710617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:11.750678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 51/106] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:11.751337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:11.876747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b89b8a-25b3-45a7-9848-c4054b8d6cee None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:11.897903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955bc1-62a0-468d-8b90-03f569bcc6a7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:11.917797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:11.918437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.918729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.919011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.920306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:11.920682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:11.922182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f7a8-8d50-4bf3-be18-52db4ef1afc9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:11.936255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 52/107] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:11.937577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1074-4c04-4a73-a851-ada638790ffb None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:11.937916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1074-4c04-4a73-a851-ada638790ffb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:11.938180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1074-4c04-4a73-a851-ada638790ffb None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:11.940883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 53/108] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:11.945583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1074-4c04-4a73-a851-ada638790ffb None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.001502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.003406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.003973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.004449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.009125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.017842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-712bbd6e-de09-494a-b22e-9ef29472d4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:12.024685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:12.044094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 56/109] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:12.044953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.045723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.045723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.054433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:12.056074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:12.092004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1074-4c04-4a73-a851-ada638790ffb None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.132922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.133486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.133807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.134052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.135476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.136878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.138621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 54/110] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:11 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:12.139222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.141410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 57/111] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:12.142521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.180695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.252997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.257347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8956a3-3678-46ac-bf85-e0f707ad11cf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.274329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21effc-e063-4099-9f61-7427c794dc3d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.299582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.300771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.301239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.302045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.303815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.306125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242746a-2ad2-45b4-94b4-7250471f6a0f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.308790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 55/112] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:12.310239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d607b-8b4e-4dd1-88fb-0407681dbd99 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.310703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d607b-8b4e-4dd1-88fb-0407681dbd99 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.311144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d607b-8b4e-4dd1-88fb-0407681dbd99 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.312646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 56/113] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:12.313860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d607b-8b4e-4dd1-88fb-0407681dbd99 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.326665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.327306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.327593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.327874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.328586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:12.328903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.331009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.344537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 58/114] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:12.344537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.431796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d607b-8b4e-4dd1-88fb-0407681dbd99 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.445011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.454121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87919-2a70-48cb-a939-f0ebc3f590ff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.466296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.466948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.467234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.467510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.468690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.470165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.472718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:12.473494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.492836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.493480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.493758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.494030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.505558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:12.510350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2a613217-6986-46b3-94d1-fcd24129e581 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:12.510486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:12.511398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:12.512149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 59/116] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:12.513223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.513580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.513741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.533134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:12.535861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:12.581762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8580cf-d63b-492f-8b20-87af09c11d6e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.609768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 60/117] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:12.610650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.618830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.619593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.619882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.620161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.620967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.622663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.730982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 58/118] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:45:12 2022] POST /identity/v3/projects => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:12.732318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.740575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.776789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48994f-a987-4243-bd62-992a7325fda6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.847701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.849585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.850641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.851774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.854458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:12.857530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:12.861225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 61/119] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:12.868757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:12.870707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:12.885602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c7958-fe08-4884-a9b4-9130f8a3f182 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:12.934297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:12.935196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:12.935493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:12.935793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:12.949159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:12.954087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:12.955171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 59/120] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:12.956828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.038341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a787e-1eb2-4616-b084-c65a5458bd86 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.083466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.084154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.084446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.084761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/f3d7167a4d1049d3a536c8bc86d11745/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.086759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, user_id=f3d7167a4d1049d3a536c8bc86d11745, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.088357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.129483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51683ef-62d6-4026-a505-0a06dfd04b6a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.166782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.167412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.167703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.167986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.168694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:13.169012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.170415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.181086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 62/121] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:12 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/f3d7167a4d1049d3a536c8bc86d11745/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:13.181739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.182218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 60/122] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:13.183191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.200376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:13.207197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:13.316068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b30f1-7482-4d05-9ba8-590c742a95c7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.323042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf2226-3f49-43ea-8e02-0f3a1ed2d6c4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.364529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.365554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.365729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.366217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.366412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.366666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.366949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.367293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.368189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.369735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.372205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 63/123] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:13.377941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.389592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:13.396255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:13.397245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:13.398040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 61/124] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:13.398696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.481006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:13.510287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:13.523727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadd65-3270-4895-a9ee-42ebc39eeebe None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.542504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e5a4-7540-4c49-a69a-0682590786d1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.581983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.582909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.583029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.583838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.583941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.584353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.584594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.584858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.585642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:13.586125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.586661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.587913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.589075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.593031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 62/125] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:13.594289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.599436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 64/126] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:13.600555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.718101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121654-56aa-4f3b-a48f-21a9d50e3931 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.765292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.766355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.766842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.767614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/1ba15123fbd2428d82b676fd494c4a7b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.771113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, user_id=1ba15123fbd2428d82b676fd494c4a7b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.772966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.830821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7d61-9842-46a7-9888-b78606101693 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:13.889224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:13.889775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.890137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.890419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.891095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:13.891406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:13.893456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:13.903904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:13.905094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 65/127] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:13.916696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 63/128] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:13 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/1ba15123fbd2428d82b676fd494c4a7b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:13.916696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.916979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:13.917719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:14.151982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842928-7ac8-4463-97dc-c99862e3bb1e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.177884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2b43-cbfe-4d3a-9902-9fced82049d1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.221833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.223103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.223571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.224067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] PATH_INFO: `/v3/projects/1e6b3024dd644b3dbca8e2e144b46258` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.224169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.227492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.227492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.227492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] PATH_INFO: `/v3/users/87d8fd13672f47ab9e04699f36315ccc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.228982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] RBAC: Authorizing `identity:get_project(project_id=1e6b3024dd644b3dbca8e2e144b46258)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:14.230634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:14.235881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 66/129] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/projects/1e6b3024dd644b3dbca8e2e144b46258 => generated 312 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:14.236802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.244772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] RBAC: Authorizing `identity:get_user(user_id=87d8fd13672f47ab9e04699f36315ccc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:14.246654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:14.249875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 64/130] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:13 2022] GET /identity/v3/users/87d8fd13672f47ab9e04699f36315ccc => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:14.250967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.325473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:14.377839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc10dc2-e7ed-4906-b9bd-36a69c0472d9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.417858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.418551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.418905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.419280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] PATH_INFO: `/v3/projects/1e6b3024dd644b3dbca8e2e144b46258/users/f3d7167a4d1049d3a536c8bc86d11745/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.421740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e6b3024dd644b3dbca8e2e144b46258, user_id=f3d7167a4d1049d3a536c8bc86d11745, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:14.423348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:14.436382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:14.480906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c26e-ef01-440b-8b70-9951da00975b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.515470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 65/131] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:14 2022] PUT /identity/v3/projects/1e6b3024dd644b3dbca8e2e144b46258/users/f3d7167a4d1049d3a536c8bc86d11745/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:14.516315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.534126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828930-b885-45be-b680-de0a4279b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.535307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828930-b885-45be-b680-de0a4279b79e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.535670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828930-b885-45be-b680-de0a4279b79e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.535958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828930-b885-45be-b680-de0a4279b79e None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.541377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77828930-b885-45be-b680-de0a4279b79e None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:14.543024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77828930-b885-45be-b680-de0a4279b79e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:14.544955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 67/132] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:14 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:14.551749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828930-b885-45be-b680-de0a4279b79e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.702657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a0b67-074b-40b3-9ef9-10764a918ef3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.760919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:14.793489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828930-b885-45be-b680-de0a4279b79e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:14.797465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.798418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.799506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.800252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.864150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:14.865289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:14.865772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:14.866228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.868194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:14.870771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:14.876579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 68/133] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:14 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:14.882774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.907121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.017756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:15.019607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:15.129662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc9b0d-bbd3-4cbd-bdf3-e444cb596cee None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:15.212592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:15.214532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.214532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.214532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/f3d7167a4d1049d3a536c8bc86d11745/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.216359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, user_id=f3d7167a4d1049d3a536c8bc86d11745, role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:15.224554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:15.245133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 66/134] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:15.251418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:15.280824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.376432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 69/135] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:14 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/f3d7167a4d1049d3a536c8bc86d11745/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:45:15.399385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e042b-de79-45b6-9588-e6dfc05371c9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:15.450995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:15.452051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.452612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.453123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.454633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:15.457488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c88b1-9647-4dd2-aace-0a781b2d60b3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:15.459745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 67/136] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:15 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:15.465799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:15.593492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.618041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01daffd-314b-4df9-8209-9f62d1f6d72b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.618716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01daffd-314b-4df9-8209-9f62d1f6d72b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.619197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01daffd-314b-4df9-8209-9f62d1f6d72b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.621190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 68/137] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:15.626792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905370-fba9-42b0-93d3-f1b9ff1d1a40 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.628140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905370-fba9-42b0-93d3-f1b9ff1d1a40 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.628861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905370-fba9-42b0-93d3-f1b9ff1d1a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.665445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2d905370-fba9-42b0-93d3-f1b9ff1d1a40 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:15.667046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2d905370-fba9-42b0-93d3-f1b9ff1d1a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:15.677666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c0d6-81b2-4c13-88f0-9f9666f5976c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:15.736489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:15.737210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.737493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.738125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.739026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=87d8fd13672f47ab9e04699f36315ccc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:15.739492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:15.741178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571988-589b-46e7-bcec-40e0888a17ee None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:15.747861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 70/138] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:15 2022] GET /identity/v3/role_assignments?user.id=87d8fd13672f47ab9e04699f36315ccc&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:15.806249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 69/139] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:16.291126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce976-5afb-40ca-91f3-2f9133587a18 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:16.292196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce976-5afb-40ca-91f3-2f9133587a18 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:16.292770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ce976-5afb-40ca-91f3-2f9133587a18 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:16.294335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 71/140] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:16.301204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:16.301845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:16.302332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:16.326226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:16.327843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:16.339896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:16.388593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ce976-5afb-40ca-91f3-2f9133587a18 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:16.453799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 70/141] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:16.584403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ce976-5afb-40ca-91f3-2f9133587a18 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:16.619695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:16.625900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:16.626557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:16.626846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:16.627730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:16.647165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:16.647165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:16.647165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 72/142] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:16.647402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:16.785178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80015-879b-4af7-b962-9b9f961b26ad None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:16.844003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:16.844630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:16.844869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:16.845164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:16.845953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:16.847422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:16.952266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:17.027307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:17.036700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 71/143] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:16 2022] POST /identity/v3/users => generated 283 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:17.169593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6f6f-7160-4fff-aabc-1cbfc2a87c3a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:17.225368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:17.226050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.226341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.226638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.240501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-059a54ef-23b0-4b2c-b0a3-80029d71b500 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:17.246035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:17.253564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:17.255403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 73/144] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:17.260907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:17.430011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05d58-d0ce-431d-ac50-96e91c25a0e8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:17.487667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521db3-d9e1-4c2b-9eeb-d17ed6ae0142 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.488503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521db3-d9e1-4c2b-9eeb-d17ed6ae0142 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.488685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90521db3-d9e1-4c2b-9eeb-d17ed6ae0142 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.491316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 74/145] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:17.510264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:17.510874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.511255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.511626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.512449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.513230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.513924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.515414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:17.516142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:17.525503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:17.548412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 72/146] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:17.554964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:17.566147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:17.568117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:17.646131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:17.691900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aeebca-b9c3-4fba-a1d7-32df54316485 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:17.708127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:17.738253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:17.739475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.739927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.740351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.742440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:17.744598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:17.747076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 73/147] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:17 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:17.753322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:17.755115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 75/148] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:17.878314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa5b6-9682-401b-ab83-4c4dfa8e8c80 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:17.917092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:17.918766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:17.919587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.920018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.920439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.000030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:18.001722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:18.133079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 74/149] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:18.138924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.264781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5938e10-a0f3-43ba-ac89-6b7cc292ccdb None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:18.289123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.316274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:18.316974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.317269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.317549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.319575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:18.321233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80e65-b851-4469-9f50-8ac5124b0d1f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:18.323032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 76/150] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:18.325118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e45-43d6-4240-a449-fe4ec4505f18 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.325118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e45-43d6-4240-a449-fe4ec4505f18 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.325118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b896e45-43d6-4240-a449-fe4ec4505f18 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.326481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 77/151] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:18.332146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b896e45-43d6-4240-a449-fe4ec4505f18 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.347214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:18.485886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:18.492722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c221-5d03-45bb-afd5-44a781575f47 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:18.562495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:18.563079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.563354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.563624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.586447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1700504b-a9ef-4c9b-bf99-d0abc9b0233d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:18.592729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:18.593651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:18.594420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:18.598270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 75/152] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:18.600300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.600837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.601336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.617860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b896e45-43d6-4240-a449-fe4ec4505f18 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:18.624232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:18.625797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:18.681299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:18.681941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.682221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.682510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.683245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:18.683552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:18.685073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:18.698104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 78/153] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=f500e18e097649cf98678fa3334fb969 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:18.698888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.778064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 76/154] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:18.825384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb19553-26f7-4a68-82df-45f928edf3b8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:18.851054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:18.869038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:18.870055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.870536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.871009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.871894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:18.872414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:18.874184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:18.886239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 79/155] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:18.894766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.943578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:19.062897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc3e2-7e9c-4126-93b9-fbc4d6dcd4e2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:19.137849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:19.138459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:19.138746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:19.139018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] PATH_INFO: `/v3/users/1ba15123fbd2428d82b676fd494c4a7b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:19.140409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba15123fbd2428d82b676fd494c4a7b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:19.142005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:19.144279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 77/156] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/users/1ba15123fbd2428d82b676fd494c4a7b => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:19.157635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:19.339361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c0d07-eb0b-4376-9bd8-9ed2af1ac2b4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:19.399675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:19.400936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:19.401680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:19.402187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:19.422232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:19.474284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:19.509373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:19.510947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f466e0-3686-4f91-9a0f-295815e8e499 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:19.680999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:19.714122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ad4c5-e20a-4976-9438-c901520168a1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:19.753882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 80/157] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:19.758672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554dca1-83b8-4463-8cd4-ab9c3b145276 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:19.759120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554dca1-83b8-4463-8cd4-ab9c3b145276 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:19.759390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554dca1-83b8-4463-8cd4-ab9c3b145276 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:19.760900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 81/158] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:19.761734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554dca1-83b8-4463-8cd4-ab9c3b145276 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:19.797628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:19.798689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:19.799644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:19.799934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:19.832469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4af7faf0-131d-4e0a-88bd-e2b559103e09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:19.842078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:19.843044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:19.843834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:19.851219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 78/159] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:19.853056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:19.853348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:19.853624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:19.904201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:19.906023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:19.995810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.029857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554dca1-83b8-4463-8cd4-ab9c3b145276 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:20.119026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 79/160] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:20.134539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:20.141190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:20.142293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.143026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.144303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.149450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:20.152473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c0078-1ad6-4ca0-a921-40208c3311f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:20.162939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 82/161] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:19 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:20.164282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394701-5289-4559-8b03-0fbfa3e6d29c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.164600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394701-5289-4559-8b03-0fbfa3e6d29c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.165425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394701-5289-4559-8b03-0fbfa3e6d29c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.166524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 83/162] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:20.176558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394701-5289-4559-8b03-0fbfa3e6d29c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:20.328725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.381097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8475ab-6b3a-4052-a938-9a7957191daf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:20.435426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394701-5289-4559-8b03-0fbfa3e6d29c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:20.449959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:20.450957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.451466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.451935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.453013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:20.453547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:20.455304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2072295-1d8d-4900-b05c-67b7445efe70 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:20.476751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 80/163] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:20.478538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.479060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.479664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.517682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:20.520191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:20.527950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:20.528677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.528972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.529248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.530084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=1ba15123fbd2428d82b676fd494c4a7b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:20.530399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:20.531994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:20.546348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 84/164] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:20 2022] GET /identity/v3/role_assignments?user.id=1ba15123fbd2428d82b676fd494c4a7b&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:20.547215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:20.585024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.675837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 81/165] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:20.676920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:20.814790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:20.831889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e64ae-9098-41e4-bf28-494cc1c3837c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:20.884900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c64e2-7908-4999-9a64-680e9ec3db1a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:20.916775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:20.917440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.917721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.917997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.919365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:20.920881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:20.922768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 85/166] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:20 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:20.930501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:20.967714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:20.968747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:20.969040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:20.969320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:20.992702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:20.998740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:20.999824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:21.001083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 82/167] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:21.009848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:21.117839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:21.142151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509104-29cd-49b2-9b41-a36c5d6bb140 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:21.238525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:21.239523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.239991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.240474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.282212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dfa62-ddb4-42fe-9831-452042c28137 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:21.377074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:21.406011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:21.406583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.406869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.407137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.407837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:21.408298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:21.410185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:21.424895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:21.427483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:21.444065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 83/168] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:21.463938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:21.632089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540c408-c62e-4056-a421-e93b963d4ddf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:21.646716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 86/169] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:21.647472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:21.654141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:21.688702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:21.690912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.691477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.692051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] PATH_INFO: `/v3/users/f3d7167a4d1049d3a536c8bc86d11745` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.694317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d7167a4d1049d3a536c8bc86d11745)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:21.697134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cebf4-1a39-48c3-ba9f-9fb013908009 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:21.700237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 84/170] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:21 2022] GET /identity/v3/users/f3d7167a4d1049d3a536c8bc86d11745 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:21.702084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9db8-f088-411a-a0df-154ec091d6e0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.702605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9db8-f088-411a-a0df-154ec091d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.703112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a9db8-f088-411a-a0df-154ec091d6e0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.705960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 85/171] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:21.707350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9db8-f088-411a-a0df-154ec091d6e0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:21.813193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:21.841616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da2555-4bf1-4707-ab7e-9965a866176a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:21.907372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a9db8-f088-411a-a0df-154ec091d6e0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:21.912708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:21.914083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.914760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.915461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.938887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:21.949814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:21.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:21.953505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:21.957639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 87/172] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:21.959494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:21.976154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:21.977032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.977173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.977506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] PATH_INFO: `/v3/projects/1e6b3024dd644b3dbca8e2e144b46258` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:21.979526 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] RBAC: Authorizing `identity:get_project(project_id=1e6b3024dd644b3dbca8e2e144b46258)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:21.981244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696265ce-a4ad-474e-815d-a9aedbb6d058 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:21.984095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 86/173] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:21 2022] GET /identity/v3/projects/1e6b3024dd644b3dbca8e2e144b46258 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:21.990464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:21.991276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:21.991968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.026610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:22.029124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:22.042731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.131643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d566-a8bc-455a-b9bb-ae2826c7f520 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.155153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 87/174] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:22.156843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.175773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.177035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.177379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.177715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.242989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.303804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56aecd-3800-48aa-92f4-c547b46f6713 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.327517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:22.333049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57eaa7-920a-45c0-b4ad-642a43a6f047 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:22.357482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.358724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.359018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.359297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.359986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:22.360291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:22.362411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:22.373861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 88/175] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:22.374753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.433135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.537107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 88/176] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:22.539730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3fa1a-95b0-4537-9f87-79d6394832cc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.540541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3fa1a-95b0-4537-9f87-79d6394832cc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.541361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3fa1a-95b0-4537-9f87-79d6394832cc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.544057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 89/177] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:22.545740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3fa1a-95b0-4537-9f87-79d6394832cc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.560539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35471-8377-481f-bd41-7384ab92564b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.583371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.597551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.598176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.598454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.598729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.599464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=1e6b3024dd644b3dbca8e2e144b46258, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:22.599769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:22.601269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:22.607139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 89/178] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=1e6b3024dd644b3dbca8e2e144b46258&role.id=f500e18e097649cf98678fa3334fb969 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:22.607953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.684397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3fa1a-95b0-4537-9f87-79d6394832cc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.732800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.733458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.733740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.734019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] PATH_INFO: `/v3/users/87d8fd13672f47ab9e04699f36315ccc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.735266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] RBAC: Authorizing `identity:get_user(user_id=87d8fd13672f47ab9e04699f36315ccc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:22.737159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29160bb-49bf-49a3-879a-ee8488bd74b7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:22.738568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 90/179] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/users/87d8fd13672f47ab9e04699f36315ccc => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:22.739817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ca18-094f-4b88-9fb7-47b79e7d2048 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.740103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ca18-094f-4b88-9fb7-47b79e7d2048 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.740363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ca18-094f-4b88-9fb7-47b79e7d2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.741866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363c475-34bb-49bd-95bd-6c04de8a361c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.760273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7bb4ca18-094f-4b88-9fb7-47b79e7d2048 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:22.761549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7bb4ca18-094f-4b88-9fb7-47b79e7d2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:22.766140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.784418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.785765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.786210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.786658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.788754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:22.791150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:22.793405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 90/180] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:22.794234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.866496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 91/181] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:22.868110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce462-31a5-4943-8751-974bcaa9e072 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.868722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce462-31a5-4943-8751-974bcaa9e072 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.869005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce462-31a5-4943-8751-974bcaa9e072 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.870313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 92/182] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:22.871044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce462-31a5-4943-8751-974bcaa9e072 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:22.871614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:22.931501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8decc-a2e5-46f6-944a-6ea200498366 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:22.980841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:22.981502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.981769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.982109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.995949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:23.002282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:23.003662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 91/183] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:23.004477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.016193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce462-31a5-4943-8751-974bcaa9e072 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.058019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.058602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.058880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.059148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.060329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.061917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13cda5-5cd9-40f2-8431-e34bbcae2fe4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.068777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 93/184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:22 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.068777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.068777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.068777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.087252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:23.088480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:23.090817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.127512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321b9-d6e4-48b0-afd8-22d22000d44d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.143124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.166032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.166649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.166990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.167274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.168019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=f3d7167a4d1049d3a536c8bc86d11745) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:23.168330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.169809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.175756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 94/185] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:23.175925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 92/186] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/role_assignments?user.id=f3d7167a4d1049d3a536c8bc86d11745&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.176756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.177200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.329346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0543-1ab8-4d54-9df8-0841a12169a1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.376374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.378118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.378685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.379279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/87d8fd13672f47ab9e04699f36315ccc/roles/8323fdf1655b4f1e95982156fff13a56` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.381694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, user_id=87d8fd13672f47ab9e04699f36315ccc, role_id=8323fdf1655b4f1e95982156fff13a56)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.382397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377a6e-ed86-4fc6-9682-b6ef53dd99b3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.383718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.425525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.426685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.427087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.427368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.428127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:23.428440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.429951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.440974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 93/187] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.442063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.461423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.471538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 95/188] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:23 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/users/87d8fd13672f47ab9e04699f36315ccc/roles/8323fdf1655b4f1e95982156fff13a56 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:23.473233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.497256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.579911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6bc6-0c93-4d0f-84c0-f6b278af89cb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.617528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1a48-e6a3-4fe4-a6ce-41f9380b4c7f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.645806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.646893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.647412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.647883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.658042 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.658990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.659334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.659951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.667676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:23.678440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:23.678753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:23.679821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:23.680974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:23.682130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.686436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.688497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 96/190] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.689285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.774223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.823396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6998-0014-451d-9846-6e3d81aa79a3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.834714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.838803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b28c-76af-46a6-9017-3db05d093eec None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.863364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.864063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.864353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.864668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.865371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:23.865677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.867096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.876292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 97/191] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.876473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.876823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.877759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.878103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.879612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:23.881183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:23.881855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.887452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 95/192] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:23.887452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.001740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4983cc-3197-4be5-97ac-8a55c69b73b3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.023034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d7d6-eb00-4476-a5a3-5386f2315405 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.041437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.042103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.042389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.042668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.044167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.044666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.045571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.047261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:24.053546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.063263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.063908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.064190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.064590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.098672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.151192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.152852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.174651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3cdc9-21c0-46fb-a627-5860065f0baf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.210932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.211552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.211832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.212104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.212800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.214258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.270616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 98/194] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:24.271492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.303404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.388347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e8302-a755-4051-a402-d5bbb6d0d1e2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.420713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 97/195] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:24 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:24.432486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.432659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.432757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.433084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.433389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.548645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.552385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.583230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.602306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.616551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e95b1-d4a9-4453-be9f-ece8aa9d5bad None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.676251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.676864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.677147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.677426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.681282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.681693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.690619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 98/196] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:24 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:24.692216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.710811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 99/197] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:24.716973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.842712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4000b2-bd8d-45a4-a9de-138af952ba8e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.865956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce387f-aebf-43b5-b666-a4ae055172d3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:24.889742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.890785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.892677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.893034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.894176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=1f35f0e612aa4968b4b3290a91df71c5) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:24.894490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.895999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.897832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:24.902562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 99/198] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:24 2022] GET /identity/v3/role_assignments?user.id=1f35f0e612aa4968b4b3290a91df71c5&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:24.931370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:24.931971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:24.932253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:24.938017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:24.940006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.941854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e025002-10c9-4744-8e32-a24fef55644d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.944943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 100/199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:24 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:24.950825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:24.988149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:25.087628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eb447-9a83-4d41-b32c-b55d64c453e6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:25.131391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:25.132031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:25.132319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:25.132628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:25.133464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=1f35f0e612aa4968b4b3290a91df71c5) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:25.133781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:25.135277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8526-452e-418f-a267-fdc265dfa12f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:25.142140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 100/200] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:24 2022] GET /identity/v3/role_assignments?user.id=1f35f0e612aa4968b4b3290a91df71c5&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:26.359479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3617a-f7d6-4aa6-a908-1242b5ffae93 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:26.360059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3617a-f7d6-4aa6-a908-1242b5ffae93 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:26.360059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3617a-f7d6-4aa6-a908-1242b5ffae93 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:26.361689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 101/201] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:26.367593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:26.368646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:26.369145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:26.389287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:26.390861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:26.473217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 101/202] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:26.878655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3617a-f7d6-4aa6-a908-1242b5ffae93 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:27.006596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3617a-f7d6-4aa6-a908-1242b5ffae93 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:27.045530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:27.046183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.046468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.046744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.058442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:27.063863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:27.065650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:27.066477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 102/203] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:27.073179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:27.123181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:27.334910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744dfd8-3de3-436c-8d7a-b480961d74cd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:27.388637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:27.389294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.389545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.389812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.390495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:27.390796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:27.392186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ef2d-b230-4548-826c-b0511cebeab3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:27.405842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 102/204] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:27.413017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:27.527066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d34-5adf-43b8-9e64-246393e04547 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.527489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d34-5adf-43b8-9e64-246393e04547 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.527933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30d34-5adf-43b8-9e64-246393e04547 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.529748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 103/205] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:27.538012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.538310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.538630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.542824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:27.576704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:27.580554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:27.660429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a6bbb-6998-476c-9ee2-72e3beead7a4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:27.700197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 104/206] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:27.726626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:27.726626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.726626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.726626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] PATH_INFO: `/v3/users/87d8fd13672f47ab9e04699f36315ccc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.728410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] RBAC: Authorizing `identity:get_user(user_id=87d8fd13672f47ab9e04699f36315ccc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:27.730103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87c90-b4e3-4b32-a01a-a11b61ee976f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:27.731891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 103/207] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:27 2022] GET /identity/v3/users/87d8fd13672f47ab9e04699f36315ccc => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:27.739347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:27.758776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:27.784056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502582e-2969-4c5a-8161-eca0ef80dd4c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.784970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502582e-2969-4c5a-8161-eca0ef80dd4c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.785585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502582e-2969-4c5a-8161-eca0ef80dd4c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.787559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 104/208] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:27.793809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.794399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.795029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.832672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:27.835171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:27.979977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96e57-f169-4212-9182-cf517bdd3cb7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:27.998476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 105/209] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:28.007217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.078786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.081257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.082113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.082554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.082976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.162115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbee66-cecc-44cd-ac9c-7b878b53b2ae None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.186413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.188635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406838-02f8-4a5b-8dac-34baf8954b96 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.204581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.213938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.214570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.214852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.215125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.216635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.218339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca789f5-96a9-4e13-aa3d-4a1a1c58c3c6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.228766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 106/210] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:28.228766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1fa2-6dd6-47d8-a185-15e357a1c247 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.228766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1fa2-6dd6-47d8-a185-15e357a1c247 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.228766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1fa2-6dd6-47d8-a185-15e357a1c247 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.229856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 107/211] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:28.232799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e1fa2-6dd6-47d8-a185-15e357a1c247 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.312557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 105/212] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:28.313112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063a86-cfb4-4def-a38d-a2f7f14c01ed None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.313399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063a86-cfb4-4def-a38d-a2f7f14c01ed None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.313668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d063a86-cfb4-4def-a38d-a2f7f14c01ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.334523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0d063a86-cfb4-4def-a38d-a2f7f14c01ed None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:28.335735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0d063a86-cfb4-4def-a38d-a2f7f14c01ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:28.352500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e1fa2-6dd6-47d8-a185-15e357a1c247 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.366725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.387736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.388349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.388673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.388941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.389598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.391024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.405663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 106/213] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:28.407144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde33b3-1447-464e-a1d1-a92134c20065 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.407444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde33b3-1447-464e-a1d1-a92134c20065 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.407725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde33b3-1447-464e-a1d1-a92134c20065 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.409715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 107/214] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:28.410626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde33b3-1447-464e-a1d1-a92134c20065 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.456821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.517050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 108/215] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:28 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:45:28.518062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.538462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde33b3-1447-464e-a1d1-a92134c20065 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.597325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.598674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.599150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.599909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.602497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.603998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273794a-8297-4ef6-9727-1ddb0a9c5b10 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.605830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 108/216] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:28.607310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.607600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.607878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.629281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:28.630660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:28.660029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48705b0-3443-472c-925f-f8a8eee33a5e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.705668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.706423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.706708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.707008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.713379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 109/217] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:28.714219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.741364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:28.749736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:28.750744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:28.751535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 109/218] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:28.755251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.765657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.796687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:28.851497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6ae6c-2a16-472d-9be8-25f6e1601046 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.899623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.900293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.900612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.900890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:28.901633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1, user.id=87d8fd13672f47ab9e04699f36315ccc) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:28.901940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.903411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.908738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99793-d6c4-43ce-9d55-e783372f8010 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:28.913015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 110/219] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/role_assignments?user.id=87d8fd13672f47ab9e04699f36315ccc&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:28.914488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:28.981977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:28.982652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:28.982943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:28.983215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.007545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:29.016958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:29.017994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:29.018839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:29.019904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 110/220] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:29.028994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.072467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87377194-b60d-4762-896c-02523a01a0b3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.076913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.126774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.127529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.127816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.128203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.128957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:29.129267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.130718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.140839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 111/221] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.141782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.149609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.164028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb3ba-72b1-48b3-9454-691278119e6e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.208837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.209491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.209770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:29.252952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:29.253716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:29.254525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:29.255432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 111/222] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:29.255432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.291189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8514ac-5b4d-49ad-982c-4211d5f08844 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.400748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.400748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.400748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.400748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.401370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:29.401370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.401370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.401370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 112/223] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.401370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.401741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62bc3e-5abf-4647-89e9-2358417bacfb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.401827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.425765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.426583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.426968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.427346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] PATH_INFO: `/v3/users/fb4170a2098948248703f1b5ea1119e3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.497345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bdac-8608-46fe-8aa4-47e9091afe5d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.540936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.541591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.542175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.542462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.543187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:29.543504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.544031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4170a2098948248703f1b5ea1119e3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.544948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.546322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.548399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 112/224] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/users/fb4170a2098948248703f1b5ea1119e3 => generated 297 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.550025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.558248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 113/225] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.559240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.560313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.664917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5023de-5d70-45f1-9f78-8c1392d34448 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.688908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.703754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd977372-c57f-462e-b35c-6f912812d84b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.715548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.716199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.721336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.721336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.721336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.721336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.722285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 113/226] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.727283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.763549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.764990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.765673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.766098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.829110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:29.863310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdee1cf-d310-4b0a-ae0f-d42165e61e09 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:29.864726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.867728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.914874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:29.915752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:29.916068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:29.916432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:29.917733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:29.920735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:29.922874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 114/227] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:29.923903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:29.996804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:30.014539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 114/228] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:30.015201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:30.060705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c8a3-094d-4fa7-83f1-5260565d7332 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.107445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.108335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.108819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.109235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.110564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.112390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.114310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 115/229] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:29 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:30.120186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:30.134962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:30.146918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e749690-64ef-4c95-95a5-7c19a63eb53c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.187329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.188063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.188443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.189015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.191052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.193154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.196281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 115/230] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:30 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:30.197502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:30.242969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05738ab1-bb6a-4486-b5ee-d25041b3f52f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.259823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:30.283769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.284505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.285062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.285343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.286532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.288009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.290046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 116/231] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:30 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:30.290864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:30.310663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8c57-7306-442f-92b9-b1d544d1294d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.352326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.353188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.353469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.353745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/1f35f0e612aa4968b4b3290a91df71c5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.355697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, user_id=1f35f0e612aa4968b4b3290a91df71c5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.357175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.388072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:30.412086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a8c1-7f35-43b4-aef8-b388fd640d4b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.446097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 116/232] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:30 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/1f35f0e612aa4968b4b3290a91df71c5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:30.447243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:30.461194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.462750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.463411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.464015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/1f35f0e612aa4968b4b3290a91df71c5/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.467617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, user_id=1f35f0e612aa4968b4b3290a91df71c5, role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.470185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd652-bb7b-41f9-99cf-98fa1202b6db None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.569286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 117/233] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:30 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/1f35f0e612aa4968b4b3290a91df71c5/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:30.596013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260d170-18b6-4472-8199-fe3150fec92b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:30.623283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:30.650994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:30.651708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.651995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.652273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.653101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=fb4170a2098948248703f1b5ea1119e3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:30.653466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:30.654994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e93ab-db65-48dd-b448-138e9a572ba9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:30.663489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 117/234] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:30 2022] GET /identity/v3/role_assignments?user.id=fb4170a2098948248703f1b5ea1119e3&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=f500e18e097649cf98678fa3334fb969 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:31.371898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c387-8f48-4bf7-83e3-455ffb338d25 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:31.372187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c387-8f48-4bf7-83e3-455ffb338d25 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:31.372475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c387-8f48-4bf7-83e3-455ffb338d25 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:31.373879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 118/235] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:31.380217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:31.380622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:31.380959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:31.409618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:31.411174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:31.457149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08b9d5-c650-4f24-88cc-734573a0a733 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:31.457149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08b9d5-c650-4f24-88cc-734573a0a733 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:31.457149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08b9d5-c650-4f24-88cc-734573a0a733 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:31.457149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 119/236] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:31.462987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:31.463545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:31.464034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:31.493753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:31.495008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:31.520126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 118/237] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:31.627837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 120/238] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:31.813634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:31.974386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322d69f-c043-4f4d-bded-9afde3209b36 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:31.986919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.019220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.020157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.020610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.020932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.023199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:32.043928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:32.053611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:32.054532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:32.055327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:32.056394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 119/239] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:32.062083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:32.144936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.212850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77bfc-ba13-4938-b30b-a334d1772ced None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:32.229329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b666dcc-dcdd-4569-be6e-523d79fcda67 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:32.273838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.274732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.275024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.275358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.280547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:32.280547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:32.280547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:32.290038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 120/240] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:32.296583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:32.306089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.307029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.307518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.308018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.313216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:32.315492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:32.317684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 121/241] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:32.329526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:32.349303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.474102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f478f8d-9bbe-4169-9bde-4be1d7e438ba None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:32.517938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.517938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.517938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.517938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] PATH_INFO: `/v3/users/f9a08659964240af8551a71e286de94b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.545303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1ee42-c460-439f-9a3a-f8b54b59e3c3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:32.550095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a08659964240af8551a71e286de94b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:32.551584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:32.557670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 121/242] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:32 2022] GET /identity/v3/users/f9a08659964240af8551a71e286de94b => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:32.558635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:32.583089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.583944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.584373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.584819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.585626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:32.587347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:32.598013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.661020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.672922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a7c3-b741-4c65-bbb9-53db12677a28 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:32.721704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:32.722338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:32.722668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:32.722942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:32.763362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 122/243] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:32 2022] POST /identity/v3/users => generated 293 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:45:32.796967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:32.798375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:32.896424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:32.910980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 122/244] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:32.917696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:33.089377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf7241-e559-43e1-8068-93a5bd738f7e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:33.140438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:33.141137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.141420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.141699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.144248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:33.145818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1868528-cce1-40ea-b199-dfbec7f8999d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:33.147650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 123/245] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:32 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:33.153554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:33.249669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03afb8-281a-4dfe-8539-2cc8036260f7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.249975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03afb8-281a-4dfe-8539-2cc8036260f7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.250269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03afb8-281a-4dfe-8539-2cc8036260f7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.251808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 124/246] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:33.260271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ae4c-5284-45ce-aea5-ca4eda95f268 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.260603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ae4c-5284-45ce-aea5-ca4eda95f268 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.260888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791ae4c-5284-45ce-aea5-ca4eda95f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.286628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8791ae4c-5284-45ce-aea5-ca4eda95f268 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:33.288299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8791ae4c-5284-45ce-aea5-ca4eda95f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:33.293955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37fdf-2f6e-4eb8-91f2-fc197afd53d6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:33.338399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:33.339030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.339311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.339637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.340469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=f9a08659964240af8551a71e286de94b) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:33.342079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:33.343563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c78af-5371-446c-92a2-a33f455597cd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:33.351006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 123/247] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:33 2022] GET /identity/v3/role_assignments?user.id=f9a08659964240af8551a71e286de94b&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:33.388692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:33.403067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 125/248] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:33.444882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591bc2-a2ec-430a-adff-03ad2ef4f23f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.445174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591bc2-a2ec-430a-adff-03ad2ef4f23f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.445458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e591bc2-a2ec-430a-adff-03ad2ef4f23f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.447088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 124/249] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:33.454286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f03a2-27eb-43e4-95db-0c899e034648 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.454640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f03a2-27eb-43e4-95db-0c899e034648 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.454817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f03a2-27eb-43e4-95db-0c899e034648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.480306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cd2f03a2-27eb-43e4-95db-0c899e034648 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:33.481676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cd2f03a2-27eb-43e4-95db-0c899e034648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:33.572174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 126/250] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:33.620403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7dee2-2863-4072-9a4e-c86bd2cbd009 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.620690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7dee2-2863-4072-9a4e-c86bd2cbd009 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.620906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7dee2-2863-4072-9a4e-c86bd2cbd009 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.622467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 125/251] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:33.628859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab964-c975-473a-a526-24e625efe604 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.629147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab964-c975-473a-a526-24e625efe604 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.629429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab964-c975-473a-a526-24e625efe604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.657540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-16aab964-c975-473a-a526-24e625efe604 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:33.659245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-16aab964-c975-473a-a526-24e625efe604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:33.751653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 127/252] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:33.772278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7dee2-2863-4072-9a4e-c86bd2cbd009 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:33.857219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:33.923927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7dee2-2863-4072-9a4e-c86bd2cbd009 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:33.968702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:33.969350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:33.969635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:33.969920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:33.989558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:33.995125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:33.996028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:33.997471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 126/253] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:34.003570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab964-c975-473a-a526-24e625efe604 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.036211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.090525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.182567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab964-c975-473a-a526-24e625efe604 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.219305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734c8c-5576-4930-8924-4dc99e192962 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.242652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.243286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.243417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.243744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.244027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.244745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:34.245056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:34.246445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:34.268852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 128/254] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:34.269726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.283305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.283966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.284252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.284537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.303689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:34.311717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:34.312634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:34.313412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:34.314683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 127/255] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:34.316892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.445409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7000c-6243-4673-b6b6-a7150242ab83 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.460623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.501127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456355e5-e58e-4838-971b-965a7819484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.502469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456355e5-e58e-4838-971b-965a7819484d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.503432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456355e5-e58e-4838-971b-965a7819484d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.503719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456355e5-e58e-4838-971b-965a7819484d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.529086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456355e5-e58e-4838-971b-965a7819484d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-456355e5-e58e-4838-971b-965a7819484d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:34.542584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:34.543531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 129/256] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:34.544773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456355e5-e58e-4838-971b-965a7819484d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.548092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c767f-0342-4dba-bbdc-123fbdcae213 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.590117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.591897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.592187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.592467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.596114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:34.599206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:34.601111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 128/257] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:34.601896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.677622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.756456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456355e5-e58e-4838-971b-965a7819484d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.774193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554fc9b-0dd2-47a0-acc6-597908e7122b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.819974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.820746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.821153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.821434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.822315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:34.822500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:34.822636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:34.822996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.823279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.823557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.823987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:34.824275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:34.824613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:34.825992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:34.835385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 129/258] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:34.838790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 130/259] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:34.841512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.845420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:34.888764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.986953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce551e-f522-4c3e-b80e-6c107202dbe4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:34.988844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.998444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55a0b5-0362-43f9-b18b-c0a3bb1f033a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.035547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.037176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.037995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.041581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.073408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.076095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.077962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.078447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] PATH_INFO: `/v3/users/1f35f0e612aa4968b4b3290a91df71c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.081392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] RBAC: Authorizing `identity:get_user(user_id=1f35f0e612aa4968b4b3290a91df71c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.083084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.087691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 131/260] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/users/1f35f0e612aa4968b4b3290a91df71c5 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:35.093965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.193249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.195108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.284763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751f2d-9733-494e-aaab-9dae9faee1af None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.287383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:35.325452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.326439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.326978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.327451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] PATH_INFO: `/v3/users/fb4170a2098948248703f1b5ea1119e3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.333782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4170a2098948248703f1b5ea1119e3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.335511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.337373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 132/261] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/users/fb4170a2098948248703f1b5ea1119e3 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:35.338533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.406367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 130/262] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:35.407697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.416389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:35.554077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d00eb7-bb3e-4cee-8904-2496e6638e16 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.582451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422f8c-e04f-4dda-9ea3-062678ed098a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.624711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.625732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.626218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.626700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.658777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.659801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.660577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.661070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.662439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.664190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.666384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 131/263] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:35.667363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.732893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:35.753965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:35.802386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e58b5-fd01-4746-b3cb-a57e3ffd2bd0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.813671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.815199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.842629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.843700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.844168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.844653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.846363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.848251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.850811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 132/264] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:35.851778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.994704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 133/265] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:35.995960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:36.052244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4d82-32a0-4cf7-ae67-8ace74d131c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:36.093704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.098589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:36.099260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.099536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.099806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/fb4170a2098948248703f1b5ea1119e3/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.101788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, user_id=fb4170a2098948248703f1b5ea1119e3, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:36.103588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7c0f-d3e2-41cf-b37e-286d32e947b2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:36.127290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba04b7-00fd-486e-a46c-803652010f24 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:36.165237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:36.165855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.166140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.166414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.167147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=1f35f0e612aa4968b4b3290a91df71c5) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:36.167459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:36.169014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b84f32-4ec1-4b23-b7af-055dff800bfe None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:36.175900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 134/266] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/role_assignments?user.id=1f35f0e612aa4968b4b3290a91df71c5&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:36.177849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12bd6d-a131-4137-bc53-d90f5ef8d78c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.178138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12bd6d-a131-4137-bc53-d90f5ef8d78c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.178415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12bd6d-a131-4137-bc53-d90f5ef8d78c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.179909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 135/267] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:36.180545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12bd6d-a131-4137-bc53-d90f5ef8d78c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:36.224884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.230234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 133/268] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:35 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/fb4170a2098948248703f1b5ea1119e3/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:36.233018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f4e5-bd96-4bad-a99f-93ab2b9798a6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.233598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f4e5-bd96-4bad-a99f-93ab2b9798a6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.234113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f4e5-bd96-4bad-a99f-93ab2b9798a6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.235712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 134/269] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:36.238547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96bc33-8634-4b62-9471-f8c9d74357ad None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.240251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96bc33-8634-4b62-9471-f8c9d74357ad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.241248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96bc33-8634-4b62-9471-f8c9d74357ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.270070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2c96bc33-8634-4b62-9471-f8c9d74357ad None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:36.273049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2c96bc33-8634-4b62-9471-f8c9d74357ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:36.357927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12bd6d-a131-4137-bc53-d90f5ef8d78c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:36.381006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 135/270] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:36.382359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80866-ce22-42bc-a35c-d5b3a038c76a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.382651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80866-ce22-42bc-a35c-d5b3a038c76a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.382925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80866-ce22-42bc-a35c-d5b3a038c76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.406061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-73e80866-ce22-42bc-a35c-d5b3a038c76a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:36.408121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-73e80866-ce22-42bc-a35c-d5b3a038c76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:36.411361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:36.412026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.412312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.412699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.414036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:36.415588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60615-2b4b-4dda-96f9-e88cc179f35e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:36.417561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 136/271] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:36 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:36.422865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e595-6ee6-435a-87c9-48545bf4d290 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.422865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e595-6ee6-435a-87c9-48545bf4d290 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.422865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571e595-6ee6-435a-87c9-48545bf4d290 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.422865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 137/272] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:36.427774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571e595-6ee6-435a-87c9-48545bf4d290 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:36.430994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.516959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 136/273] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:36.519069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.519365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.519637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.550776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:36.552337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:36.594639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571e595-6ee6-435a-87c9-48545bf4d290 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:36.620665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.638192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 137/274] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:36.662919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:36.663953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:36.664420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:36.664918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:36.666235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=1f35f0e612aa4968b4b3290a91df71c5) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:36.666747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:36.669545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:36.684666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 138/275] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:36 2022] GET /identity/v3/role_assignments?user.id=1f35f0e612aa4968b4b3290a91df71c5&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:36.908138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:36.928893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.023310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.054651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76858f-e416-43c6-86f3-7010b2220368 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.070836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03d786-71ca-429d-bc8f-93a6fcda884e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.094516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.096081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.096405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.096718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.097929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.099499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.101245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 138/276] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.105417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.112452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.113223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.113503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.113777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.126259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:37.134386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:37.135518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:37.136338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 139/277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:37.137122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.170373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.215546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bd935-c020-45b6-ae5a-a6573e4999f2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.252850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.253539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a63a-94d5-4cd2-8467-0f45e5a5539f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.253654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.253944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.254193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.266348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:37.271455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:37.272568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 139/278] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:37.273394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.288771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.299289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.300460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.300783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.301064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.301726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.303426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.382049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485bb57-9aba-4e3a-8111-769fe2f620c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.400129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.418263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.418870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.419151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.419421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.420083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:37.420429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.421784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.430971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 140/279] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.431855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.455329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 140/280] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:37 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:37.456776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.567308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732db325-767f-4aac-83f7-2de71df230a0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.616753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.617997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.618813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.619635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.620566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:37.621242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.623648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.629366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51115e44-5e06-47b5-a03c-9045a968ecc0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.637029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 141/281] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.645622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.688463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.689079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.689904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.690819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] PATH_INFO: `/v3/users/3e01803c57dd43c89ad3742bbe782045` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.703114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.708111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] RBAC: Authorizing `identity:get_user(user_id=3e01803c57dd43c89ad3742bbe782045)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.709605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.711293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 141/282] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/users/3e01803c57dd43c89ad3742bbe782045 => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.717288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.776443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9842a8-603d-4706-9ab5-7b88ddedf114 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.777380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:37.816733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.818463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.818902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.819332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] PATH_INFO: `/v3/users/f9a08659964240af8551a71e286de94b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.820769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] RBAC: Authorizing `identity:get_user(user_id=f9a08659964240af8551a71e286de94b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.822523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.824866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 142/283] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/users/f9a08659964240af8551a71e286de94b => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.831495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:37.861917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc7308-1385-4b95-b70f-3aa06068b175 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.931775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:37.932498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:37.932922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:37.933194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:37.933931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, user.id=3e01803c57dd43c89ad3742bbe782045, scope.system=all) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:37.934239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:37.935684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:37.944623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 142/284] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/role_assignments?user.id=3e01803c57dd43c89ad3742bbe782045&scope.system=all&role.id=f500e18e097649cf98678fa3334fb969 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:37.982968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276807d7-7baf-4859-ae21-dcb0bc63c13e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:37.997747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:38.026529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:38.027196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:38.027532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:38.027806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:38.029060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:38.030631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9fdb-3ca5-4d52-8f2b-2c54d74cb79f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:38.032846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 143/285] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:37 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:38.039091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:38.165007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8745-885e-448b-b3e6-42408f8a5d29 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:38.167601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:38.206774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:38.207387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:38.207671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:38.207951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/f9a08659964240af8551a71e286de94b/roles/8323fdf1655b4f1e95982156fff13a56` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:38.209990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, user_id=f9a08659964240af8551a71e286de94b, role_id=8323fdf1655b4f1e95982156fff13a56)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:38.211455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547c268-1cd2-494e-86c1-2b628594edf2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:38.414890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 143/286] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:38 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/users/f9a08659964240af8551a71e286de94b/roles/8323fdf1655b4f1e95982156fff13a56 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:39.028550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7e79-6f3a-455c-bda5-a9a012478063 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:39.028550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7e79-6f3a-455c-bda5-a9a012478063 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:39.028550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7e79-6f3a-455c-bda5-a9a012478063 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:39.030390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 144/287] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:39.042693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:39.043275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:39.043737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:39.066672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:39.068346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:39.191574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 144/288] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:39.594225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7e79-6f3a-455c-bda5-a9a012478063 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:39.726158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7e79-6f3a-455c-bda5-a9a012478063 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:39.772048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:39.772713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:39.772995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:39.773273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:39.790254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:39.795749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:39.796731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:39.797544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 145/289] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:39.805048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:39.950560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:39.957457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb4fd5-ae07-456a-b247-c45c7be9c619 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:40.012623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:40.013275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.013561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.013850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.014543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:40.014852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:40.016242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:40.028327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 145/290] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:40.034371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:40.102513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:40.192245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc46e1-be0e-4109-a128-1ebd0608bc4b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:40.239533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:40.240185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.240463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.240760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] PATH_INFO: `/v3/users/fb4170a2098948248703f1b5ea1119e3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.241924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4170a2098948248703f1b5ea1119e3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:40.243514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c24f0-90a3-4af8-bf9c-29780f9b92d7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:40.245127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 146/291] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:40 2022] GET /identity/v3/users/fb4170a2098948248703f1b5ea1119e3 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:40.250917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:40.439022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2114-88f9-4e79-a486-ed0303bd6c5c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:40.490237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:40.490795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.491084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.491364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.526478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:40.543746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeecaf-eed9-4069-8108-ab31404b7a94 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.545671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeecaf-eed9-4069-8108-ab31404b7a94 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.545671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeecaf-eed9-4069-8108-ab31404b7a94 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.546420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 147/292] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:40.552563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329650eb-0d68-4604-a7d3-ba5c77bb251f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.553161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329650eb-0d68-4604-a7d3-ba5c77bb251f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.553663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329650eb-0d68-4604-a7d3-ba5c77bb251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.581665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-329650eb-0d68-4604-a7d3-ba5c77bb251f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:40.582917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-329650eb-0d68-4604-a7d3-ba5c77bb251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:40.600591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:40.602079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:40.715973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 148/293] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:40.718349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034514-7db7-43b3-943f-ae46141d0ae4 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.719176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034514-7db7-43b3-943f-ae46141d0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.720068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034514-7db7-43b3-943f-ae46141d0ae4 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.722508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 149/294] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:40.724240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 146/295] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:40.731873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:40.732226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196b80-195a-41a0-a4cb-8e7c3d3bcf61 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.732699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196b80-195a-41a0-a4cb-8e7c3d3bcf61 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.733120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64196b80-195a-41a0-a4cb-8e7c3d3bcf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.762912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-64196b80-195a-41a0-a4cb-8e7c3d3bcf61 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:40.765191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-64196b80-195a-41a0-a4cb-8e7c3d3bcf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:40.822595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:40.834362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:40.868394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 150/296] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:40.877022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82a5d-bc03-45f5-9b4b-c96bf714fb22 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.877530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82a5d-bc03-45f5-9b4b-c96bf714fb22 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.877990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82a5d-bc03-45f5-9b4b-c96bf714fb22 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.879500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 151/297] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:40.885001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.885484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.885989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.889614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b22cc9-6d2e-4d6d-bac1-02cc407bcd5c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:40.920128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:40.921729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:40.944161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:40.945818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:40.946405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:40.948229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:40.950526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:40.952391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:40.954256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 147/298] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:40 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:40.961412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.040210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 152/299] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:41.041209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.154313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a959de-3a71-41b1-a6a8-0965c2ded39d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.192648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.207049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.207673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.207955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.208232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.209000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=fb4170a2098948248703f1b5ea1119e3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:41.209313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.210893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.216110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.217364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 148/300] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:40 2022] GET /identity/v3/role_assignments?user.id=fb4170a2098948248703f1b5ea1119e3&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=f500e18e097649cf98678fa3334fb969 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:41.218434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.225469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e510af-9305-4b04-9ec1-2160ed10a6e0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.293276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.294161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.294590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.295024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.309338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-800d22c3-a0ac-4d94-bba5-3cfae13ae1c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:41.314979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:41.315962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:41.316792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:41.319425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 153/301] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:41.321300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdda07-5d36-4e2f-b3dc-c09081d5af21 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.321779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdda07-5d36-4e2f-b3dc-c09081d5af21 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.322224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdda07-5d36-4e2f-b3dc-c09081d5af21 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.328136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 154/302] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:41.329564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdda07-5d36-4e2f-b3dc-c09081d5af21 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.368497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc078c7e-734a-4ec1-831b-77b31c6a40da None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.412357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.413427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.413853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.414426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.416498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.418206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcada2ce-ebab-4a02-820b-8b83225c5db4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.419987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 149/303] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:41.421191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.421542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.421825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.441678 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:41.442895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:41.465725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdda07-5d36-4e2f-b3dc-c09081d5af21 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.504937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.505555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.505839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.506114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.506779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:41.507083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.508809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.512143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.517194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 155/304] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:41.518989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.532832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 150/305] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:41.533817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.544136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.638755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088352d8-ccf3-4ee3-b11a-3c410bcea070 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.646696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16203b-643a-43df-a00c-43e8cdec3d21 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.678936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.679730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.680036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.680634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.685327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.685897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.686183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.686456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] PATH_INFO: `/v3/groups` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.687094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.689106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.690976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:41.695811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:41.696848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:41.697660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 156/306] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:41.698316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.776480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.795037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 151/307] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Sep 8 13:45:41 2022] POST /identity/v3/groups => generated 229 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:41.795893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.809965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fdfb6-9e40-42fa-82b3-586342d5eed7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.851006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.851678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.851960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.852237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] PATH_INFO: `/v3/users/c335925be89a46f889735114f5b75df3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.853405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:41.867309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] RBAC: Authorizing `identity:get_user(user_id=c335925be89a46f889735114f5b75df3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.868846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.870575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 157/308] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/users/c335925be89a46f889735114f5b75df3 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:41.871401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.922075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d6f6-f109-4fb7-a4f0-dbc3c2c3c36a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:41.969133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:41.970199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:41.970345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:41.970686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:41.971330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:41.971636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:41.973065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:41.983810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 152/309] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:41.984695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:41.994237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2ef3-ef7b-4609-b8c5-6739b89310a1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.035532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.036176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.036831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.036831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.039041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:42.049472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:42.056135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:42.057299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:42.058086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:42.059221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 158/310] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:42.061961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:42.104054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f95d-9382-468a-b9e1-cabab7969212 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.114739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:42.142568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.143560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.143848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.144128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.144889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, user.id=c335925be89a46f889735114f5b75df3, scope.system=all) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:42.145203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.146658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.152174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 153/311] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Sep 8 13:45:41 2022] GET /identity/v3/role_assignments?user.id=c335925be89a46f889735114f5b75df3&scope.system=all&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:42.153516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:42.172959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4003e-cce0-43ac-89f3-d91d0717f5c9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.228476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.230208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.230700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.231150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] PATH_INFO: `/v3/users/3e01803c57dd43c89ad3742bbe782045` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.232678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] RBAC: Authorizing `identity:get_user(user_id=3e01803c57dd43c89ad3742bbe782045)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.235155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.237949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 159/312] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:42 2022] GET /identity/v3/users/3e01803c57dd43c89ad3742bbe782045 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:42.245624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:42.302782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a7c-1c4e-4ea6-821c-5eac34a9484d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.336015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:42.359156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.359806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.360091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.360365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.361909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:42.362335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.363963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.373994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 154/313] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:42.378966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:42.387538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024ff2d-bb88-4cdb-9569-b5cba8c8b31d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.414741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:42.429140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.430133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.432799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.432799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] PATH_INFO: `/v3/system/users/3e01803c57dd43c89ad3742bbe782045/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.432799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e01803c57dd43c89ad3742bbe782045, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.434359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.489375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891ee6-aea1-452e-8911-68a522f42f2b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.526438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.527529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.527998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.528457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] PATH_INFO: `/v3/users/f9a08659964240af8551a71e286de94b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.529845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] RBAC: Authorizing `identity:get_user(user_id=f9a08659964240af8551a71e286de94b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.531472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.533980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 155/314] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:42 2022] GET /identity/v3/users/f9a08659964240af8551a71e286de94b => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:42.539943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:42.560742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 160/315] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Sep 8 13:45:42 2022] PUT /identity/v3/system/users/3e01803c57dd43c89ad3742bbe782045/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:42.673117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96324184-8a16-4b00-b3c1-fabb7b86ba4e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:42.674947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:42.712692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:42.713428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:42.713718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:42.713995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:42.797099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:42.799519 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:42.916567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 156/316] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:42.922988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:43.044169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8790b-7bd8-4224-a4e1-95aec6590805 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:43.071422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:43.080766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:43.081423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:43.081802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:43.082080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:43.083317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:43.084806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a82023-4cfa-4647-8e31-b1862991962e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:43.086765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 161/317] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:42 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:43.092345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:43.094689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:43.204044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b88e88-09bc-4d92-885f-c7590ea92cd0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:43.241943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:43.242555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:43.242839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:43.243116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:43.243847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, scope.project.id=0d7324f817b243db829f7b3ddcbdf801, user.id=f9a08659964240af8551a71e286de94b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:43.244160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:43.245636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ab5a1-8324-4226-8f24-643ab1b369cf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:43.251646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 157/318] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:43 2022] GET /identity/v3/role_assignments?user.id=f9a08659964240af8551a71e286de94b&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:44.066003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af211d-e005-4ba6-abc8-90b3ceb9b23f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.066355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af211d-e005-4ba6-abc8-90b3ceb9b23f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af211d-e005-4ba6-abc8-90b3ceb9b23f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.068120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 162/319] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:44.073370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c693f-1040-4826-8a13-34311c3b3b2a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.073851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c693f-1040-4826-8a13-34311c3b3b2a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.073925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c693f-1040-4826-8a13-34311c3b3b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.092065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e09c693f-1040-4826-8a13-34311c3b3b2a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:44.093293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e09c693f-1040-4826-8a13-34311c3b3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:44.155872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:44.164283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 158/320] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:44.435233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af211d-e005-4ba6-abc8-90b3ceb9b23f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:44.473544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e90-f3e8-49eb-a9c4-2e6da6dd4217 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.473832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e90-f3e8-49eb-a9c4-2e6da6dd4217 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.474109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0e90-f3e8-49eb-a9c4-2e6da6dd4217 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.475480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 159/321] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:44.480979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.481263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.481560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.517137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:44.521209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:44.570836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af211d-e005-4ba6-abc8-90b3ceb9b23f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:44.608609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:44.609250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.609530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.609803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.612545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 160/322] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:44.612686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:44.613107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177dc51-e9b8-483a-9f69-bf5dde2c50b2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:44.614821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 163/323] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:44.620607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:44.729205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9784d-445d-4f74-8be4-3745f0815b93 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:44.758395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:44.768367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:44.769390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.769833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.774457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] PATH_INFO: `/v3/groups` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.774457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:44.774457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e6d4-a549-4e72-ae16-081eeecfb4a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:44.883654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39f3d-095b-46d5-a1e2-3c87e8805c29 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.883964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39f3d-095b-46d5-a1e2-3c87e8805c29 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.884236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39f3d-095b-46d5-a1e2-3c87e8805c29 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:44.885608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 164/324] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:44.886863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39f3d-095b-46d5-a1e2-3c87e8805c29 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:44.948933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:44.988249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39f3d-095b-46d5-a1e2-3c87e8805c29 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:44.988825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 161/325] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Sep 8 13:45:44 2022] POST /identity/v3/groups => generated 226 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:45:44.990137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:44.990432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:44.990708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.011279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:45.012538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:45.034784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.035749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.036036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.036316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.049118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:45.055737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:45.057016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:45.058023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 165/326] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:45.062923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.102504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 162/327] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:45.197048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927a4a-396b-4a28-a757-abf14f39bb80 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.219950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:45.233472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.234093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.234371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.234686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.235471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:45.235773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.237819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.256663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 166/328] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:45.256894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.372914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98812cc3-972b-4e59-929c-8ff2a8e614d1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.381299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.395343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:45.414444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.415086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.415368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.415643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] PATH_INFO: `/v3/users/c335925be89a46f889735114f5b75df3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.416869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] RBAC: Authorizing `identity:get_user(user_id=c335925be89a46f889735114f5b75df3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.418309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.420103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 163/329] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/users/c335925be89a46f889735114f5b75df3 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:45.429914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.513593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883748-1535-4ac4-aba9-77babbcffff7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.560399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98669c1-cbbe-47f7-bb24-dfd1dc5637df None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.573221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.573938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.574222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.574489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.587540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:45.597424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:45.598385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:45.599178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:45.599804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 167/330] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:45.609213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.616765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.618875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.619417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.619909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] PATH_INFO: `/v3/system/users/c335925be89a46f889735114f5b75df3/roles/8323fdf1655b4f1e95982156fff13a56` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.621755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c335925be89a46f889735114f5b75df3, role_id=8323fdf1655b4f1e95982156fff13a56)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.623962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.670152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:45.733900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd76936-80f8-482e-beac-13b3e8ffb4a5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.772312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.773246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.773707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.774210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.775116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:45.775220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 164/331] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Sep 8 13:45:45 2022] PUT /identity/v3/system/users/c335925be89a46f889735114f5b75df3/roles/8323fdf1655b4f1e95982156fff13a56 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:45:45.775710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.777405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.788729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 168/332] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:45.797757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.857897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:45.945994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eeee0-f753-4b16-ace3-33806131fb06 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.991216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.991901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.992184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.992459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] PATH_INFO: `/v3/users/3e01803c57dd43c89ad3742bbe782045` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.995976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] RBAC: Authorizing `identity:get_user(user_id=3e01803c57dd43c89ad3742bbe782045)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.997518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2efda1-fe16-4c88-a796-0d2b98972fcc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.999334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 165/333] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/users/3e01803c57dd43c89ad3742bbe782045 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:46.006104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:46.122024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793e04c-3b35-43fa-ac62-e66b22ade558 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:46.130549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:46.161994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:46.162915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:46.163376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:46.163798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:46.164772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] RBAC: Adding query filter params (role.id=f500e18e097649cf98678fa3334fb969, user.id=3e01803c57dd43c89ad3742bbe782045, scope.system=all) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:46.165331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:46.167125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37509c-b05c-424c-8fa5-b50e4a17d419 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:46.181479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 169/334] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Sep 8 13:45:46 2022] GET /identity/v3/role_assignments?user.id=3e01803c57dd43c89ad3742bbe782045&scope.system=all&role.id=f500e18e097649cf98678fa3334fb969 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:47.581425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f431a-aa82-4b0c-b758-6ad6c0069868 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:47.581978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f431a-aa82-4b0c-b758-6ad6c0069868 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:47.581978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f431a-aa82-4b0c-b758-6ad6c0069868 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:47.583649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 166/335] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:47.589314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fb7a-09cf-4f67-af21-77c852ce28c5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:47.590045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fb7a-09cf-4f67-af21-77c852ce28c5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:47.590045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fb7a-09cf-4f67-af21-77c852ce28c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:47.613013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4237fb7a-09cf-4f67-af21-77c852ce28c5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:47.614216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4237fb7a-09cf-4f67-af21-77c852ce28c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:47.706972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 170/336] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:48.027545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb19c-22aa-486e-9ffc-18c54ddd00b9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.027894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb19c-22aa-486e-9ffc-18c54ddd00b9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.028100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb19c-22aa-486e-9ffc-18c54ddd00b9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.029509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 167/337] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:48.036131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.036410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.036719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.061571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:48.062787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:48.159217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 171/338] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:48.220897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb19c-22aa-486e-9ffc-18c54ddd00b9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:48.360636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb19c-22aa-486e-9ffc-18c54ddd00b9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:48.380792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:48.399840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:48.400480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.400784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.401059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.413702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c6273053-e9ce-4238-8f2b-7fceccbb0502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:48.419149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:48.420043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:48.420882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:48.425090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 168/339] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:48.429629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:48.476777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:48.487958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad5cc-9f52-4fd4-a6a6-5e478e6a99ea None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.493892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad5cc-9f52-4fd4-a6a6-5e478e6a99ea None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.493892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abad5cc-9f52-4fd4-a6a6-5e478e6a99ea None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.493892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 169/340] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:48.499327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.499852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.500328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.520659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:48.522168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:48.577605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f129157-af03-40e1-bb23-995a2942f2dc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:48.608656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 170/341] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:48.626173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:48.626864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.627309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.627757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.628687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:48.629154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:48.630681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:48.650901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 172/342] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:48.656449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:48.702279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:48.856703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1193-969f-4fb0-8277-a472ea0abe74 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:48.875032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:48.940787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:48.965283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:48.966637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.968275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.972980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.996988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b84b9-3edb-461e-ba3b-17b9ae833ec1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.085223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.085889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.086171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.086445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.108184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:49.119676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:49.120696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:49.121490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 173/343] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:49.122173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.148154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.149688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.361650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fc38d-dc2f-4944-b4ac-2039502290ce None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.392856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 171/344] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:49.393957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.424908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.435267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.435968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.448681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.448681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.468876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:49.494301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:49.495314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:49.496171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 174/345] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:49.497690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.524603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.653426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e87b-50a5-4bb4-9447-259a65269c37 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.707532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.708156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.708438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.708763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.709482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:49.709787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.711178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.716276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414becba-a7dd-4333-ba34-c0a6651b4a0a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.722569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 172/346] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:49.723871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.761947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.763210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.763721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.764295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.765867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.768447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5209fb-09c3-4785-a9c9-9175a796b8e3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.770735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 175/347] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:49.772257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b4f43-b2fd-47c4-8d31-082fcc0179d1 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.772878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b4f43-b2fd-47c4-8d31-082fcc0179d1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.773353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b4f43-b2fd-47c4-8d31-082fcc0179d1 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.775018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 176/348] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:49.776001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b4f43-b2fd-47c4-8d31-082fcc0179d1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.824875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.876260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce191-a4c4-4991-8ddc-4d505e60576a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.897480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.931240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.931765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.932043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.932316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.934017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:49.936745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.938772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.951137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b4f43-b2fd-47c4-8d31-082fcc0179d1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.953250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 173/349] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:49.955980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.024269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.025093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.025373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.025689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.120660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.122236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.148115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec16ea-39d1-42d5-a3e4-67c039b546cb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.199816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.208148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.209045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.212530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.212530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.215175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.217903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.219780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d36aec-6f82-44cc-a969-e9f384c62ef5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.223369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 174/350] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.225196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f720-e199-43e6-a538-a03ba55a3dbf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.225502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f720-e199-43e6-a538-a03ba55a3dbf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.225783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f720-e199-43e6-a538-a03ba55a3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.247615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 177/351] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:50.251190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6a23f720-e199-43e6-a538-a03ba55a3dbf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:50.252488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6a23f720-e199-43e6-a538-a03ba55a3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:50.253441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.356553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:50.358314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928280c-7953-4d43-a0b8-cb9101ca52c6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.358809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928280c-7953-4d43-a0b8-cb9101ca52c6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.359308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928280c-7953-4d43-a0b8-cb9101ca52c6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.361432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 176/353] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:50.365963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928280c-7953-4d43-a0b8-cb9101ca52c6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.392154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d664a3-c358-4be0-9bf0-d783037041db None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.434855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.435909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.436420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.436924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] PATH_INFO: `/v3/users/c335925be89a46f889735114f5b75df3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.440703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] RBAC: Authorizing `identity:get_user(user_id=c335925be89a46f889735114f5b75df3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.442536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.444987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 178/354] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/users/c335925be89a46f889735114f5b75df3 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.446044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.493627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928280c-7953-4d43-a0b8-cb9101ca52c6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.499022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.533718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.534332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.534610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.534884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.535957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:50.536184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.537772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43f1e8-b6ff-450b-b840-355e39a570d9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.544832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 177/355] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=f500e18e097649cf98678fa3334fb969 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.546333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8879bb-cfdc-48f5-9dcd-a9d7de2d5468 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.546616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8879bb-cfdc-48f5-9dcd-a9d7de2d5468 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.546888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8879bb-cfdc-48f5-9dcd-a9d7de2d5468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.565541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b5f3-a2fb-4642-89d3-7787b8351930 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.567852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.570662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9b8879bb-cfdc-48f5-9dcd-a9d7de2d5468 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:50.571874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9b8879bb-cfdc-48f5-9dcd-a9d7de2d5468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:50.608558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.609987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.610479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.610963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.613192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.615060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.618864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 179/356] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.620241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.664414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 178/357] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:50.665720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1838f-a5ba-4f41-9cd3-f86c7a4e71a7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.666010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1838f-a5ba-4f41-9cd3-f86c7a4e71a7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.666501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1838f-a5ba-4f41-9cd3-f86c7a4e71a7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.667769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 179/358] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:50.668475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1838f-a5ba-4f41-9cd3-f86c7a4e71a7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.758365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80e5c-3266-4602-8532-dcb3044ae87d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.772236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.801711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.803069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.803730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.804147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.805167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] RBAC: Adding query filter params (role.id=8323fdf1655b4f1e95982156fff13a56, user.id=c335925be89a46f889735114f5b75df3, scope.system=all) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:50.805705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.807481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0cc3f-3093-4e2f-88cb-1fd6057e3f6d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.807974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1838f-a5ba-4f41-9cd3-f86c7a4e71a7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.828773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 180/359] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/role_assignments?user.id=c335925be89a46f889735114f5b75df3&scope.system=all&role.id=8323fdf1655b4f1e95982156fff13a56 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.830754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.831040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.831313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.841832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.863677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:50.865610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:50.889644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.890365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.890705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.893091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.894367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.897890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.902334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 180/360] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.904680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.999739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 181/361] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:51.000547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.037545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667a8b-add0-421a-9638-f2042438a5ab None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.075906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.076602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.076890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.077164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.091892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:51.099032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:51.099978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:51.100892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 181/362] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:51.101545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.123636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.129309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2abe-3190-4a97-bda7-0522c89e1ff0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.163842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.181285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.181924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.182205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.182480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.183241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.183560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.185086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.198922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 182/363] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:51.200315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.236947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba577aa-1821-4016-a50b-512eeee2608c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.312975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.313866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.314461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.314974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.332258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:51.338389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:51.339521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:51.342054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:51.344780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 182/364] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:51.351403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c15dc-2e39-48f7-8edb-bddcd9876260 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.352490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.413010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.413459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.413840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.414219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.415029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.415444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.419074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.429879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 183/365] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:51.435524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.469568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.497307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66661f8-17ec-4353-84b9-9b603eac03a6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.507168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.539821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.540578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.540932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.541273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.542013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.542386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.544427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.556698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 183/366] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:51.557936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.567095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e8cd4-9286-4efb-81ae-62d8d20a29d0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.616084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.616852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.617350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.617711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.717060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf67-fd63-4694-a82e-177d1ba3acd1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.729877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.731650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.766840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.768075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.768399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.768700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.784798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:51.788938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:51.791612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:51.792562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:51.793391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 184/367] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:51.794062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.842903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.862606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 184/368] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:51.868816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.954214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb1ff5-c899-470d-960e-a261536ac988 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.995903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.996498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.996809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.997092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.007311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d677fd2-315d-4946-b768-b5b645f2e8e0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.041068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.051100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.052534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.053030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.053779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.055153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:52.055667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.057980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.071367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 185/369] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.072622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.082578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.084096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.123924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.218200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed304-55a8-46ed-ad42-bbf0741f8a88 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.223156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 185/370] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:52.224121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.277289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.278023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.278309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.278590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.279796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.283340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.285802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 186/371] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.286904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.355780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.358022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32421a-ccd8-4469-8162-0b42665744e5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.390643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.400935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.401887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.402007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.402197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.418005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91392-496a-4730-9635-e4f23aa0d45a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.464219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.465183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.466184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.466624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.468315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.471454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.474283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 187/372] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.475217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.488798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.490278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.608460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d052f0-e320-4151-aeb9-9744a96e84e5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.609292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 186/373] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:52.610183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.646321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.649446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.662802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.663461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.663749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.664027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.665283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.667332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.670090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 188/374] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.671523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.757929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec5b37-c048-4893-b76a-b0534bf3067c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.800777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3bf3b-0b87-466e-b1a8-3b916549e889 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:52.815635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.816650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.817131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.817554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.818974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.820702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.822583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 187/375] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.823513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.851363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:52.852008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:52.852289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:52.852584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] PATH_INFO: `/v3/projects/61119233e1da4995af8ba7ce35ded1dd` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:52.854405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] RBAC: Authorizing `identity:get_project(project_id=61119233e1da4995af8ba7ce35ded1dd)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:52.855860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:52.858389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 189/376] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/projects/61119233e1da4995af8ba7ce35ded1dd => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:52.859451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:52.947642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.957633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:52.965015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2eee8-dd11-4fdb-8fad-eb907c269529 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:53.006667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634719-f8ea-444f-9135-a894a1872078 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:53.007293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:53.008260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.008783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.009309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.010248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=0d7324f817b243db829f7b3ddcbdf801) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:53.010795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:53.012470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:53.019609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 188/377] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=f500e18e097649cf98678fa3334fb969 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:53.021467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:53.052304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:53.052969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.053249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.053520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.057002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=0d7324f817b243db829f7b3ddcbdf801) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:53.057318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:53.059737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:53.076174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 190/378] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:45:52 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:53.175053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd111a5c-4fd0-4f67-98f9-afebdb99399a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:53.225295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:53.225877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.226160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.226452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] PATH_INFO: `/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.232333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] RBAC: Authorizing `identity:get_group(group_id=9c38c964c1fb4560ac5ecf1fbc50e0e5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:53.233956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445c19-3898-4d7f-a3bc-49879ff1ba1e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:53.236081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 189/379] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:53 2022] GET /identity/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:53.242773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:53.368609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4bb17-9519-4ec8-8dab-d2b63f7dd507 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:53.395745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ad5b-5cb7-4203-892e-9c0c599d44f8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.396091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ad5b-5cb7-4203-892e-9c0c599d44f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.396299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10ad5b-5cb7-4203-892e-9c0c599d44f8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.397218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:53.398691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 190/380] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:53.406281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ff1c-4fd9-4607-885e-1cdc78cb3f4d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.406580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ff1c-4fd9-4607-885e-1cdc78cb3f4d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.407131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007ff1c-4fd9-4607-885e-1cdc78cb3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.413004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:53.414487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.414487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.414487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.414898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] RBAC: Adding query filter params (group.id=9c38c964c1fb4560ac5ecf1fbc50e0e5, role.id=7344c45181b34c769b527731ca22627a, scope.project.id=61119233e1da4995af8ba7ce35ded1dd) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:53.415213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:53.416706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:53.426833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 191/381] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:45:53 2022] GET /identity/v3/role_assignments?group.id=9c38c964c1fb4560ac5ecf1fbc50e0e5&scope.project.id=61119233e1da4995af8ba7ce35ded1dd&role.id=7344c45181b34c769b527731ca22627a => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:53.431794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c007ff1c-4fd9-4607-885e-1cdc78cb3f4d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:53.433040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c007ff1c-4fd9-4607-885e-1cdc78cb3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:53.455305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:53.527423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 191/382] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:53.956348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:53.966348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994ddb-8705-48cb-845e-09b7b24a282f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.966956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994ddb-8705-48cb-845e-09b7b24a282f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.966956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73994ddb-8705-48cb-845e-09b7b24a282f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.968566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 192/383] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:53.977164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.977763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.978244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.011216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:54.012458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:54.139320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 193/384] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:54.145769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1e1a2-23e0-45c8-857b-7d62297652b6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.199757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.200406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.200713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.200989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.218090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:54.223929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:54.224971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:54.225819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 192/385] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:54.231175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.331357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:54.358174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2568b-6894-43be-a29f-f063737873cd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.409313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.409944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.410230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.410759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.411450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:54.412348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:54.414367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:54.424591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 194/386] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:54.430191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.494119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:54.563476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8443d-0d67-44f4-a5c4-855c194c46c4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.570927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.610291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.611782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.612138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.612420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.613615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:54.615066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:54.616997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 193/387] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:54.623486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.775510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33573a-0d2f-483e-953d-adb34e5cd952 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.798622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:54.825325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.826449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.826735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.827015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.828193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:54.831014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:54.833793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 194/388] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:54.840153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.860123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f227-3721-494b-9e27-af9e8caeab18 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.930189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.931472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.931760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.932039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.972547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:54.976898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:54.977823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:54.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:54.981592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 195/389] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:54.988498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.003043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.056565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8580-38be-4572-ac9a-ececf423fdd0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.136214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.136935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.137218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.137494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.145269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, group_id=ef3ed2e883ad4219b2c6375671d423f1, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.146733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.181144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979544-7007-4eb5-b95c-64854ca90164 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.220031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.220740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.221212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.221740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.222423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:55.222732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.231622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 195/390] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Sep 8 13:45:54 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:45:55.235064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.247286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 196/391] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:55.252841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.307730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.379341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e8ab2-ca8c-4e41-a91c-22b9fa3c3d65 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.420414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.421141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.421422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.421752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.423116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.425367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.427378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 196/392] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:55.432992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.522984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.569389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4b55e-7ecd-4d8c-baee-7acbec581aa8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.606366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.607015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.607298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.607574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.608755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.610224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5039270-9313-4a86-afab-f948b01503a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.612238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 197/393] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:55.617788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.784959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5625-0255-4a19-99ed-56be474bb914 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.797165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.826292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.826892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.827179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.827461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.834538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4967abe0a4ad4df6baca58e818fbfab1, group_id=ef3ed2e883ad4219b2c6375671d423f1, role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.836007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b1a9-5a70-4b17-824f-10cb8f3ad5c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.031469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 197/394] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Sep 8 13:45:55 2022] PUT /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:56.036568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781b02-7151-47ac-8fc5-f1cf8068685e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.037426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781b02-7151-47ac-8fc5-f1cf8068685e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.037709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781b02-7151-47ac-8fc5-f1cf8068685e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.039358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 198/395] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:56.049017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f865-f0d4-4b1c-8aa7-ef51b1d9c793 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.049017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f865-f0d4-4b1c-8aa7-ef51b1d9c793 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.049017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f865-f0d4-4b1c-8aa7-ef51b1d9c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.073825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0128f865-f0d4-4b1c-8aa7-ef51b1d9c793 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:56.076057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0128f865-f0d4-4b1c-8aa7-ef51b1d9c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:56.147704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da34c-2579-4567-8c28-5fd9b367e684 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.148024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da34c-2579-4567-8c28-5fd9b367e684 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.148188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da34c-2579-4567-8c28-5fd9b367e684 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.149863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 199/396] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:56.158005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a24-d603-4894-900a-26d3893f9cc1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.158302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a24-d603-4894-900a-26d3893f9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.158586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3702a24-d603-4894-900a-26d3893f9cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.166393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 198/397] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:56.193737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b3702a24-d603-4894-900a-26d3893f9cc1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:56.194983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b3702a24-d603-4894-900a-26d3893f9cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:56.298844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 200/398] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:56.465351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c419e-0ebf-4d87-ba7e-7a521f8887d8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.466003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c419e-0ebf-4d87-ba7e-7a521f8887d8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.466494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c419e-0ebf-4d87-ba7e-7a521f8887d8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.468094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 199/399] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:56.474440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.475030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.475466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.484769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c419e-0ebf-4d87-ba7e-7a521f8887d8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.507604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:56.513118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:56.619424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:56.640340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 201/400] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:56.643567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:56.649979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c419e-0ebf-4d87-ba7e-7a521f8887d8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.671700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.689015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.692496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.692496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.692496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.701122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:56.706936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:56.707921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:56.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 200/401] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:56.715162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.845556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f1830-aaa0-4bb6-91fd-38c97155a758 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.884543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.885190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.885469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.885898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.898625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:56.903939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:56.904873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:45:56.905718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 202/402] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:56.913368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.915956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f4732-c116-4473-b297-b5dfbb8797bc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.978002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.979835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.980125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.980403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.981125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:56.981430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:56.982813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.996150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 201/403] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:56.998320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.009015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.033443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.061540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336816-baa4-45ac-a51b-2b1ecfc44707 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.104803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.106358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.106795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.107239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.108175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:57.108715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.110257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.111300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a40c8-c3bb-416a-a86b-a3ea680cdf37 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.122442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 203/404] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.124173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.152555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.153201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.153484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.153802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.166975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:57.180419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:57.181436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:57.182227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 202/405] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:57.182900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.249743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be3f-6a31-4db1-b2ed-a83d03549052 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.270184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.282080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.289941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.291057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.291560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.292047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.293552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.295263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.297417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 204/406] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.299055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.310466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbae0e-a6a1-46bc-8797-6fa5f62f60e7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.347127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.347897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.348035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.348304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.349544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.351116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.353160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 203/407] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.354039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.408667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237bfb2-cf9e-49d1-8226-8bcbffd3b7a3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.444500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.445565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.446067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.446560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.447439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:57.448007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.449625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.458918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 205/408] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.464023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1132e3-764c-4af5-9f34-fa68d624e109 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.464846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.501520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.502995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.504052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.504052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.504895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.506382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.514890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 204/409] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.516780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.520883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.540748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.580019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15995e7b-758d-42e8-96c0-3710fa951a83 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.617594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.618601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.619109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.619608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.621582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.624270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.626701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 206/410] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.627970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.642823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd94ec7-ec6d-4e11-9d33-2b60801bd064 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.691644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.692627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.693084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.693520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] PATH_INFO: `/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.694874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] RBAC: Authorizing `identity:get_group(group_id=9c38c964c1fb4560ac5ecf1fbc50e0e5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.696698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.698477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 205/411] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:57.699753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.769429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280faab1-0536-4a37-ad02-869cdba089a8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.789181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.811021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.812014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.812463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.812846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.816892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, group_id=ef3ed2e883ad4219b2c6375671d423f1, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.818287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:57.872429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:57.890542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7139b-ead2-4edb-bf91-dcf662b3b026 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:57.933169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 207/412] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Sep 8 13:45:57 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:57.934275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:57.977204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:57.977204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:57.977387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:57.980541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:57.981869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d7324f817b243db829f7b3ddcbdf801, group_id=ef3ed2e883ad4219b2c6375671d423f1, role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:57.983566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac208850-a1f5-4f36-aaff-ad5c18b5e540 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:58.116866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287d4d-8ef1-4fe4-be09-e07b41100395 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:58.166043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:58.166866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.167158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.167520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] PATH_INFO: `/v3/projects/61119233e1da4995af8ba7ce35ded1dd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.168706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 206/413] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Sep 8 13:45:57 2022] PUT /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801/groups/ef3ed2e883ad4219b2c6375671d423f1/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:58.169158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] RBAC: Authorizing `identity:get_project(project_id=61119233e1da4995af8ba7ce35ded1dd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:58.170291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53513d-f600-40ba-8682-dd2395d8b61d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.170473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:58.170627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53513d-f600-40ba-8682-dd2395d8b61d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.170869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53513d-f600-40ba-8682-dd2395d8b61d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.176555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 208/414] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:57 2022] GET /identity/v3/projects/61119233e1da4995af8ba7ce35ded1dd => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:58.180031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 207/415] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:58.182333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:58.189815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580a33-00dd-441f-99bd-7f34daf37e72 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.190468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580a33-00dd-441f-99bd-7f34daf37e72 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.191088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580a33-00dd-441f-99bd-7f34daf37e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.214220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a4580a33-00dd-441f-99bd-7f34daf37e72 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:58.216019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a4580a33-00dd-441f-99bd-7f34daf37e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:58.247930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:58.307785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 208/416] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:58.335419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dddc2-1e74-40a2-9fee-aef5a02bace3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:58.395049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:58.396210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.396780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.397272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] PATH_INFO: `/v3/projects/61119233e1da4995af8ba7ce35ded1dd/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.400725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=61119233e1da4995af8ba7ce35ded1dd, group_id=9c38c964c1fb4560ac5ecf1fbc50e0e5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:58.402650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a17492-d2c8-4724-8ac2-7b65cf5a57c3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:58.487086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 209/417] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Sep 8 13:45:58 2022] PUT /identity/v3/projects/61119233e1da4995af8ba7ce35ded1dd/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:58.678037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4875-9273-4eaf-a600-8d6f9f4425d0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.678379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4875-9273-4eaf-a600-8d6f9f4425d0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.678583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4875-9273-4eaf-a600-8d6f9f4425d0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.680201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 209/418] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:58.686153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.686475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.686729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.707723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:58.709679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:58.797441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4875-9273-4eaf-a600-8d6f9f4425d0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:58.801938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 210/419] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:45:58.897980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:58.926635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4875-9273-4eaf-a600-8d6f9f4425d0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:58.965098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:58.966079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:58.966637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:58.972536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:58.978132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:58.983368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:58.984262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:58.985140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 210/420] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:58.992660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.032252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.103483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.115560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2595d78-c120-4aa5-80b0-12c2ff3e5b71 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.154733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.155438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.155654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.155929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.156638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:59.157004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:59.158838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:59.170752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 211/421] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:59.176488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.309829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c235b7-50c9-438a-a2e5-5e43a8140b93 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.341383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.349153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10bc1b-a1bf-4b5e-9945-e058c73f2123 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.393761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.395308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.396233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.397085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.398920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.399785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.400285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.400783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.406528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.433101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:59.440332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:59.441335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:45:59.442119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:45:59.450256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 211/422] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:59.469979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.512400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:59.514357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:59.617448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.624058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 212/423] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:59.630276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.744997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754ff04-70d4-4cd1-bdd9-0a6576ffcc99 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.778448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794216-be9b-4783-9634-fd6f5dabf8eb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.789962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.790202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.790475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.792546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.796235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:59.801766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:59.809334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 213/424] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:59.810941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.865472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.866523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.867018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.867571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.868760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:59.869126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:59.870530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:59.886009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 212/425] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:59.892055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.948899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.003154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.016139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10218b-6442-4b93-9b2b-179a94df5b25 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.054499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.055141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.055418 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.055690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.056836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.058619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.061097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 214/426] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:00.069369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.088158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82ff4-3cb2-477a-8319-dac6c4d53aca None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.165527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.166069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.166353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.166629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.254995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.256957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37bfea-0f0d-46c1-9ed5-f3e645cd413c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.261175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecae646-df44-4c6b-9e04-3d93f3372db7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.318028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.333393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.343698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.344204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 215/427] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=f500e18e097649cf98678fa3334fb969 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:00.352959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.423387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 213/428] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:00.428982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.474252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187e477-1278-4fac-845d-a0931a9ac2da None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.474599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187e477-1278-4fac-845d-a0931a9ac2da None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.474830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187e477-1278-4fac-845d-a0931a9ac2da None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.476483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 214/429] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:00.482011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.482289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.482568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.502414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:00.503714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:00.606063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff735e2-1966-4652-8583-7243c725e28a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.626409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 215/430] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:00.669684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.670687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.671174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.671647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] PATH_INFO: `/v3/projects/4967abe0a4ad4df6baca58e818fbfab1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.673944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] RBAC: Authorizing `identity:get_project(project_id=4967abe0a4ad4df6baca58e818fbfab1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.675780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3a0d1-70bf-46c6-8199-b799c8ed0230 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.678108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 216/431] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/projects/4967abe0a4ad4df6baca58e818fbfab1 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:00.683554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.802042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.815191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75725c-2891-4624-b242-d75d9c81cc80 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.820964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60013-6147-4076-822b-3a36b2aa94ea None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.820964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60013-6147-4076-822b-3a36b2aa94ea None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.820964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f60013-6147-4076-822b-3a36b2aa94ea None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.820964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 217/432] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:00.822802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.823098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.823379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.846293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:00.847752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:00.859828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.860495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.860894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.861230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.862919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.868072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.868072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 216/433] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:00.877608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.934031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.945624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 218/434] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:00.977097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.021081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2108f-7e34-4e31-879e-fb1125870105 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.065441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.066075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.066357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.066632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.067373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=4967abe0a4ad4df6baca58e818fbfab1) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:01.067758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.069156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.076131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 217/435] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=4967abe0a4ad4df6baca58e818fbfab1&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:01.108103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0edaab-b00d-4daf-9a76-99948b9cdc50 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.150922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.151997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.152594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.153079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.165762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:01.171965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:01.172973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:46:01.174401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:01.177222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 219/436] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:01.183415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.215542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.269216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.343452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1955d-3eee-47b5-9965-f3568c941cf9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.350515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.386216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.386790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.386880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.387117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.387799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:01.388144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.389665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.400937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 218/437] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:01.408704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.421258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8b6d-d4b5-4af7-8632-13d41541820e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.469599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.470640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.471304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.471669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.486287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-17f1b30b-f750-4d43-a850-262e90994bac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:01.491585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:01.492626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:46:01.493433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:01.494207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 220/438] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:01.498034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1563-f851-459e-99db-5d889e83c1aa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.498404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1563-f851-459e-99db-5d889e83c1aa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.498688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1563-f851-459e-99db-5d889e83c1aa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.500209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 221/439] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:01.500846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1563-f851-459e-99db-5d889e83c1aa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.529672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.551180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54842-3fb9-44dd-a023-30f4edacfa1b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.591820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.592434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.592952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.593089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.629672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1563-f851-459e-99db-5d889e83c1aa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.646177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.666440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.667009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.667618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.667898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.668022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.668173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.668864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:01.669166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.670527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a5da7-1c81-4c56-a522-402a4ef4965f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.678764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 222/440] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:01.679966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.680240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.680500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.698366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:01.699550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:01.751501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.769812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 223/441] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:01.770673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.776092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 219/442] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:01.777011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.886876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1c041-216e-4ff2-9fa8-5d317657d7da None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.893233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92565276-7cea-4fa8-9081-690de61de4fb None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.902248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.928548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.929734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.930249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.930739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.931480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.932108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.932301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.932435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.932738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.933783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.935441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 220/443] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:01.941202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.000895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.009292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.010690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.053813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cbd85-fec1-4ac5-9b0a-8d21649f89ba None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.088913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.089546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.089827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.090104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.091231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.092772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.094346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 221/444] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:02.094346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.121490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 224/445] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:02.122379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.130883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.200139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512352-d8a3-4de2-9c27-cbe9f1193cf1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.218572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.222814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd7ba7-4440-4038-a2d6-aa880168cea4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.235759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.236460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.236773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.237538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.248175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:02.253062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:02.255685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 222/446] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:02.256532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.265731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.266722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.266722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.266954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.267892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=f500e18e097649cf98678fa3334fb969, scope.project.id=0d7324f817b243db829f7b3ddcbdf801) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:02.268206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.269787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.275812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 225/447] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=f500e18e097649cf98678fa3334fb969 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:02.276615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.371739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.379930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce342db-030e-4b30-a6ae-1e4f14349c37 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.407287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af26171-ca64-4815-972b-420bfcbaecac None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.424665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.425323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.425609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.425879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] PATH_INFO: `/v3/projects/0d7324f817b243db829f7b3ddcbdf801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.427051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] RBAC: Authorizing `identity:get_project(project_id=0d7324f817b243db829f7b3ddcbdf801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.428546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.439321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 223/448] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/projects/0d7324f817b243db829f7b3ddcbdf801 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:02.440967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.455477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.456097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.456376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.456684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.457362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:02.457671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.459054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.468690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 226/449] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:02.474744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.499034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.562687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a3aa9-37c4-44ac-95ea-77f7c5e58b97 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.600855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6ce5c-6f57-43dd-9a45-9d756ff84207 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.601891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.602538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.602820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.603099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] PATH_INFO: `/v3/groups/ef3ed2e883ad4219b2c6375671d423f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.604226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] RBAC: Authorizing `identity:get_group(group_id=ef3ed2e883ad4219b2c6375671d423f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.605832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.607435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 224/450] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/groups/ef3ed2e883ad4219b2c6375671d423f1 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:02.615317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.640659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.648166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.655960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.655960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.655960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.723633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.725155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.730982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9265ce-e88b-4daa-9f68-844369834ea3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.748918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:02.770378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.771060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.771342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.771620 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.772371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] RBAC: Adding query filter params (group.id=ef3ed2e883ad4219b2c6375671d423f1, role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=0d7324f817b243db829f7b3ddcbdf801) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:02.772711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.774247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.779946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 225/451] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/role_assignments?group.id=ef3ed2e883ad4219b2c6375671d423f1&scope.project.id=0d7324f817b243db829f7b3ddcbdf801&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:02.834181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 227/452] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:02.840089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.948708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205bba-0c9f-4435-bed6-e668333231d8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.986330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.986981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.987438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.988376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] PATH_INFO: `/v3/projects/61119233e1da4995af8ba7ce35ded1dd` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.988716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] RBAC: Authorizing `identity:get_project(project_id=61119233e1da4995af8ba7ce35ded1dd)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.990152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.992072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 226/453] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/projects/61119233e1da4995af8ba7ce35ded1dd => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:02.997484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:03.034183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:03.104137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c8fe9-c2cc-41dd-83cf-b62cc253be2e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:03.138562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:03.139210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:03.139487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:03.139757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] PATH_INFO: `/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:03.140883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] RBAC: Authorizing `identity:get_group(group_id=9c38c964c1fb4560ac5ecf1fbc50e0e5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:03.142331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c17d-ec81-4f4f-bba0-b89a13b20182 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:03.144247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 228/454] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/groups/9c38c964c1fb4560ac5ecf1fbc50e0e5 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:03.150348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:03.200026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:03.254640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05366de2-e0f2-4356-9584-a1f0cf31470b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:03.289743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:03.290347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:03.290631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:03.290908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:03.291633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] RBAC: Adding query filter params (group.id=9c38c964c1fb4560ac5ecf1fbc50e0e5, role.id=7344c45181b34c769b527731ca22627a, scope.project.id=61119233e1da4995af8ba7ce35ded1dd) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:03.291943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:03.293414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd03d8-28bd-491e-999f-2951baa9db1d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:03.299174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 227/455] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Sep 8 13:46:03 2022] GET /identity/v3/role_assignments?group.id=9c38c964c1fb4560ac5ecf1fbc50e0e5&scope.project.id=61119233e1da4995af8ba7ce35ded1dd&role.id=7344c45181b34c769b527731ca22627a => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:05.916295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7ac8-a894-48f6-842d-ecdbe8f03277 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.917164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7ac8-a894-48f6-842d-ecdbe8f03277 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.917783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7ac8-a894-48f6-842d-ecdbe8f03277 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.921159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 229/456] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:05.927143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.927650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.927725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.960973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:05.962203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:06.068751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693a4a-c92c-4a66-b8ab-19188e0b3cdd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.068967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693a4a-c92c-4a66-b8ab-19188e0b3cdd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.069500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693a4a-c92c-4a66-b8ab-19188e0b3cdd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.071527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 230/457] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:06.076559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 228/458] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:06.094426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879533fa-1344-4ab1-92c4-cfcf45019064 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.094717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879533fa-1344-4ab1-92c4-cfcf45019064 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.095166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879533fa-1344-4ab1-92c4-cfcf45019064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.130710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-879533fa-1344-4ab1-92c4-cfcf45019064 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:06.132248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-879533fa-1344-4ab1-92c4-cfcf45019064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:06.231122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 231/459] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:06.447576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.501895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.511392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb18a-8598-4568-b61f-55acee7d2427 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.515728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb18a-8598-4568-b61f-55acee7d2427 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.515728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb18a-8598-4568-b61f-55acee7d2427 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.515728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 232/460] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:06.521069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.521359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.521640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.562229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:06.563480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:06.565106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f021c-4df7-47ed-9d2e-aaa5a1409ca3 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.597238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.606263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.606910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.607198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.607523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.618709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.620212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:06.637898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:06.638864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:06.639703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:06.639703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.639703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:06.639703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 229/461] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:06.644589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.651543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 233/462] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:06.652261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.791743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c86c-12da-4843-8903-3891e88ce4bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.796881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.800614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695d50-eb0f-44ee-bdb3-cdf229a22123 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.835371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.835999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.836289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.838176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.839949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:06.840267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.841693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.865775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 234/463] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:06.874003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.888814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.889471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.889754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.890029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.915579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.923141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.932596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:06.950969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:06.951932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:06.952833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:06.952833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.952833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:06.956960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 230/464] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:06.960948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.019239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75866981-9596-4659-bbff-4d91f5c3acb4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.056787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.057322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.057638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.057872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.058532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.059977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb797c-7946-4635-800d-c026a16e8e65 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.091575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159063e-d469-42ce-b2c2-665416137fc8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.127438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.127744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.128018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.128291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.129034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:07.129334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.130703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.143580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 231/465] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:07.144372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.147975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.167692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 235/466] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:06 2022] POST /identity/v3/users => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:07.170873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a454-d2f9-461a-8899-2aebd7294bd6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.170873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a454-d2f9-461a-8899-2aebd7294bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.170873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a454-d2f9-461a-8899-2aebd7294bd6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.175853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 236/467] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:07.175853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a454-d2f9-461a-8899-2aebd7294bd6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.273317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a21d8-074a-4787-9264-82becb70c266 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.295180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.317653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.318684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.319390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.320090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.326724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a454-d2f9-461a-8899-2aebd7294bd6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.333821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.335803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-49018e89-7b79-4656-9cf2-daf0a53910f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:07.355420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:07.356403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:07.357308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:07.357308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:07.357308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:07.359337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 232/468] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:07.360858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.361405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.361924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.377645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259bb49-558c-4560-878b-88340b782431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.378090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259bb49-558c-4560-878b-88340b782431 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.379835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259bb49-558c-4560-878b-88340b782431 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.380111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259bb49-558c-4560-878b-88340b782431 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.380807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259bb49-558c-4560-878b-88340b782431 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.382259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259bb49-558c-4560-878b-88340b782431 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.386213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:07.386213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:07.442383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.459586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 233/469] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:07.460442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.491541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 237/470] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:07 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:07.593524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782eef-7c28-4960-b408-e2dcdabeab0b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.637241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.637528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.637807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.638492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:07.638791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.640242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f4e3-d64a-4d9d-9fdb-14b2f9130c81 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.658644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 234/471] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:07.665379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259bb49-558c-4560-878b-88340b782431 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.745531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05e34-a234-4109-853a-c32849b9a8aa None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.745867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05e34-a234-4109-853a-c32849b9a8aa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.746096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05e34-a234-4109-853a-c32849b9a8aa None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.747500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 235/472] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:07.758185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.758512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.758746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.789386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:07.790658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:07.854185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.863722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259bb49-558c-4560-878b-88340b782431 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.888651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 236/473] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:07.894189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.912462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.920429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.921584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.922048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.922949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.924104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.925851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:08.045713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4b495-ee26-4d8b-8e41-4b13df7e5bf8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:08.082916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:08.083561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:08.083838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:08.084490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:08.096609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:08.098669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:08.115650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:08.116675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:08.117560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:08.117560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:08.117560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:08.117560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 237/474] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:08.122979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:08.155411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:08.210212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 238/475] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:07 2022] POST /identity/v3/users => generated 248 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:08.213747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:08.243977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5664b1-64b2-47ac-ad24-38b9d443c048 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:08.287863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:08.288498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:08.288856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:08.289135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:08.289788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:08.290089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:08.291618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:08.306005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 238/476] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:08.311324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:08.427964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:08.441583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810f22-5707-4f3a-a409-5435c8ffddc3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:08.476749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41eea6-f83f-4403-afe3-78197c651de6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:08.486910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:08.487622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:08.487977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:08.488427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:08.489192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:08.490835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:08.519865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:08.520919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:08.521209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:08.521487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:08.522180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:08.523569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:08.567871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:46:08.567871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:46:08.567871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [parameters: {'id': 'd02542db11c343448411ea5bd9ff96bb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:46:08.567871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:46:08.574197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 239/477] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:08 2022] POST /identity/v3/users => generated 249 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Sep 08 13:46:08.598640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:46:08.599617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:46:08.600595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:46:08.601484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:46:08.602424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:46:08.603254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'id': 'd02542db11c343448411ea5bd9ff96bb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:08.604064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:46:08.606697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:08.608751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 239/478] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Sep 8 13:46:08 2022] POST /identity/v3/roles => generated 144 bytes in 387 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:08.609654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:08.788153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db0d-d274-4cb2-8735-a67fc7e8622f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:08.839305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:08.839957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:08.840243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:08.840539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:08.852282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bd54e67f-3d77-41e3-8528-cd6f912214c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:08.857745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:08.859955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:08.861935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 240/479] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:08.865731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:08.927609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:08.980347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cd670-7fb3-4240-b0de-d4cd1b541abd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:09.021119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:09.021739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.022022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.022300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.022971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:09.023279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:09.024688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf35c6-eabf-4c37-8f43-eef2049ec17b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:09.034134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 240/480] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:09.747011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822af0b-852f-4b8d-a071-e1a969c774ff None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.747526 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822af0b-852f-4b8d-a071-e1a969c774ff None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.747635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822af0b-852f-4b8d-a071-e1a969c774ff None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.749398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 241/481] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:09.755537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c71f-5a18-45f3-a2a2-6a3a57bbe25b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.755960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c71f-5a18-45f3-a2a2-6a3a57bbe25b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.756143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c71f-5a18-45f3-a2a2-6a3a57bbe25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.784942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4a93c71f-5a18-45f3-a2a2-6a3a57bbe25b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:09.786420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a93c71f-5a18-45f3-a2a2-6a3a57bbe25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:09.894264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 241/482] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:10.390518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822af0b-852f-4b8d-a071-e1a969c774ff None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.395260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.420892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6ae0d-b0b1-4233-a7fd-07d0ec3ea85e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.421517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6ae0d-b0b1-4233-a7fd-07d0ec3ea85e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.422232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6ae0d-b0b1-4233-a7fd-07d0ec3ea85e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.425209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 242/483] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:10.431946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.432593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.433143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.461516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:10.463503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:10.531560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.571210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822af0b-852f-4b8d-a071-e1a969c774ff None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.593515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 243/484] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:10.623254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.624396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.624908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.625442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.638796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:10.645212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:10.646118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:10.646923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:10.649481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 242/485] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:10.657654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.783061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2684b-668c-455f-afbf-6a104026d365 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.831584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.832602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.833088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.833635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.834515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:10.835016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:10.836719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:10.851624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 244/486] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:10.857345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.951075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.008378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783f12-d43c-452e-8e94-d1588019345e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.022742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.056530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.057463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.057745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.058020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.067697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.077019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.078682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c743c081-41ce-4de7-83b6-9f73cb1916e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:11.096135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.097117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:11.098437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:11.098437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.098437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:11.102271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 243/487] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:11.103444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962ae1-2ed5-41fd-af12-7d7cca5bf2da None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.103736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962ae1-2ed5-41fd-af12-7d7cca5bf2da None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.104018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee962ae1-2ed5-41fd-af12-7d7cca5bf2da None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.107027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 244/488] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:11.107910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962ae1-2ed5-41fd-af12-7d7cca5bf2da None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.150051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df12630-5140-4191-80ba-ec08096ebc41 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.191259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.192246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.192786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.193217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-91108fdb-43b6-4a13-9b0c-77211e4b9e20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.215198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.216247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:11.217319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 245/489] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:11.219741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.220168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.221053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.233176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee962ae1-2ed5-41fd-af12-7d7cca5bf2da None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.243611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:11.245583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:11.251016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.272761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.273629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.274105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.274521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.275745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:11.276209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.278181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.295142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 245/490] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:11.296188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.340540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 246/491] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:11.340540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.391238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.481568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a912cd-3dc5-416d-9095-1f97f533f75c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.536432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadeb3d-bce9-40da-bf66-af3120c60931 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.545242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.545932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.546213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.546491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.547760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:11.548070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.549829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.572163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 246/492] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:11.574602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.596394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.597711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.598193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.598935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.609021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.612329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.625677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e28322d4-6fb6-4f4b-8e51-c2010687a808 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:11.632410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.633415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:11.634340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:11.636993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 247/493] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:11.638493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfbabb-35b1-48f4-accd-01494565e2b5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.643927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfbabb-35b1-48f4-accd-01494565e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.643927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfbabb-35b1-48f4-accd-01494565e2b5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.643927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 248/494] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:11.644177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfbabb-35b1-48f4-accd-01494565e2b5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.707273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf25-8848-4d23-8872-333d10f78ba1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.738951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.744367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.745204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.745639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.745911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.755806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfbabb-35b1-48f4-accd-01494565e2b5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.761670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.763380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b9eacd68-7ce9-438d-9e67-4933eb52b166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:11.778945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.779879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:11.780905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:11.780905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.780905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:11.780905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 247/495] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:11.781422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.781706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.781982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.799729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.800384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.800700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.800980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.801804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:11.801944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:11.802023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.803054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:11.805117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.851966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 249/496] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:11.852807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.876246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 248/497] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:11.877823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.910809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.996459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69cc6-6adb-4f7f-9bc7-eb293c346be4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.032168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea16e6-19cb-48ba-8e5f-e6932ce44d03 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.039038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.040291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.041041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.041336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.054226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:12.059126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.060022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:12.060878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 250/498] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:12.061565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.066934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.075285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.075906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.085863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.085863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.085863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.085863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.085863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5db4b-f3f1-48a9-b459-047eecd92ceb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 249/499] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdd63-20fc-4cc3-830d-8981811fb203 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdd63-20fc-4cc3-830d-8981811fb203 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fdd63-20fc-4cc3-830d-8981811fb203 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 250/500] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:12.096435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fdd63-20fc-4cc3-830d-8981811fb203 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.180656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d193-5a87-4309-9697-5154ce561a6f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.182333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.202378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fdd63-20fc-4cc3-830d-8981811fb203 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.215140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.215744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.216026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.216303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.238610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.239215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.239495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.239766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.240420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.240799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.242178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.250087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 251/501] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.250816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.290552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.292067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348f1d-20b3-4de8-a998-770d736eaa38 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.294902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.352035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545976f-2d62-406c-b43b-1914a9fde063 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.385144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.385771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.386048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.386319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.394671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.396143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.398693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 251/502] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:12.399982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.400263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.400716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:12.414489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.415547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:12.416465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 252/503] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:12.417060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.421292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:12.422521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:12.422665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.492565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 252/504] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:12.493077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.528006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.536324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fd3ee-f450-49c4-b201-1bb29f479483 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.575017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.575984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.576445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.576927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.587993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:12.594246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709418-cd09-4434-8997-4fc5aa87a4c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:12.594563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.596018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:12.597053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 253/505] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:12.597723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.634962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.635611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.635896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.636170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.647614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.649098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.665297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:12.665942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.666841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:12.667679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:12.667679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:12.667679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:12.667679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 253/506] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:12.667887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.713352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fafe59-aa60-425f-a10c-ca32b24ab892 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.749074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.749694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.749974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.750249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.757742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.764030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.765528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.774754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e61530-6b6e-4662-8865-e92008d4a476 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:12.780726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.781598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:12.782448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:12.782448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:12.782448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:12.782448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 254/507] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:12.782710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.813102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.813709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.814559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.815025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.815962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.816274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.817756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.835608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 254/508] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.836455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.891543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b64a7-15ab-4119-90d3-442c0e65dc5b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.905994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.925956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.926573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.926852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.927169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.927787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.928092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.929503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.938876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 255/509] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.940209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.945357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629adf0d-4463-462b-99d8-07085edc9a3a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.980656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.981260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.981610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.981882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.982517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.982817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.984184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.995477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 255/510] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.996480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.000483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.046854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4023e4-6592-4a5f-ac34-bc68df580d28 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.083962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.084616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.084899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.085173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.097136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.098094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadffb1-5b85-4082-a558-a91a0594be63 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.099487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:13.115043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:13.115987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:13.116881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:13.116881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.116881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:13.116881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 256/511] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:13.117274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.138658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.139269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.139566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.139818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.140456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:13.140790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.142550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.145947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.154496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 256/512] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:13.155388 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.220683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.221395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430fb82-adec-41a5-97bb-bc3b1340552c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.256351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.256989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.257279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.257604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.261635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be059-99cd-4bfe-bbac-b4d03eabc9c2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.295453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.296090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.296374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.296689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.307587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.309029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:13.324279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:13.325421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:13.326394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:13.326394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.326394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:13.326394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 257/513] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:13.326394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.327830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.329443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.356497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.430729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce6726-a033-42ea-ba70-9dcdfc350564 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.431348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 257/514] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:13.432187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.452313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.470159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.471356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.471656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.471890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.479505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.481035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:13.493338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:13.494414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 258/515] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:13.495332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.538882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6b3aa-43ba-4b67-8d7f-2c6489589208 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.565674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.573066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.573677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.573952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.574220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.574853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:13.580559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.580559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.588497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 258/516] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:13.589461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.600252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8481c-f39a-41ff-acd6-cedcd40292d2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.635254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.635916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.636182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.636468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.643458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.644956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:13.658249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:13.660098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 259/517] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:13.662639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.696318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2990b-7b6c-4928-b5e2-4b13a0fe9518 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.699414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.730425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.731028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.731306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.731576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.732217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:13.732531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.734016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.746618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 259/518] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:13.747444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.768317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a37ab-699b-4caf-96c0-64af150b5a39 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.798147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.802492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.803128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.803409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.803686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.815751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.817189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:13.832199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:13.833333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:13.834343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:13.834343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:13.834343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:13.834343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 260/519] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:13.834343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.855949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1abfcd-5258-4bae-b243-d0e1f72db565 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.889819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.890421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.890702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.890981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.891755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:13.892899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.894188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:13.922264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.931811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 260/520] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:13.932694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.935568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23c238-5cbe-4f65-b269-d4aa4abbfbb4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.974424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.975040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.975320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.975594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.976273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:13.977743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.033995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff7a3-90c2-4320-b3b5-542bdb036dfc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.041638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.068714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.069294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.069573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.069844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.070537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:14.070841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.072278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.087232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 261/521] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:13 2022] POST /identity/v3/users => generated 247 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:14.087232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.100830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 261/522] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:14.100830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.225657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b700e-4bac-4da2-8f2f-cf0eaf9ecdf7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.226081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483cba-da35-4e26-a6cd-dfc10c398fa0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.265769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.266611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.268535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.268782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.268876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.269131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.269224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.269307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.269379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:14.269585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.271164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.277410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.279348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.283619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 262/523] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:14.284440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:14.291826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:14.292786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:14.293662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 262/524] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:14.294958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.298499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.323214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.403562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d1931-e690-442e-9061-5e67c81b8a63 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.404376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1b25b-a522-44b1-813d-c77db825f872 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.440878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.441410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.441528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.441767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.442012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.442124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.442294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.442562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.442770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:14.443189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.444680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.460938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 263/525] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:14.460938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.541438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.543119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.565099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.578984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.617404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb84f5-b17b-4e52-85ab-c9a7e6bda8a1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.663140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.663789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.664069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.664446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.670199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 263/526] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:14.671560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.671676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.673085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:14.690745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:14.691817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:14.692867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:14.693770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 264/527] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:14.694567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.790428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7458-75ad-4982-b056-b2d9ae78a849 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.807259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50723487-c2e6-431b-bb8b-776fddb8edb0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:14.827793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.828780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.829339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.830337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.831282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:14.831844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.833524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.835749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.844443 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:14.845120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:14.846836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:14.846836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:14.858173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.858737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 264/528] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:14.859196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.860273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:14.875038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:14.876044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:14.877801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:14.877801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:14.877801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:14.881389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 265/529] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:14.882339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:14.892938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:14.995533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede588-c205-4700-a31d-022cd319d001 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.007545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a4e4a-e5e8-42db-87f3-1027b34ddeaf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.042336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.042991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.043270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.043541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.044262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.044594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.046330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.052268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.053177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.053636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.054058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.059879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 265/530] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:15.060802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.109016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.112280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.134470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.136384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5db061-58d4-4baf-b60e-94b138ac0b3d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.211631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.212760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.213020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.213103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.213732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.214033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.215415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.229512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 266/531] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:15.230378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.255177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 266/532] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:15.256435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.341110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68fb5d-d4df-4da6-9015-a84a44a7ff06 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.343560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.350824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.371890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145820d-5b48-4d8a-b0d8-e23e121520b0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.379200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.379857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.380138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.380408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.381163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=5b1ae9fed0454cb390554e3ad0ef580e) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.381467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.383384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.390028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 267/533] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/role_assignments?user.id=5b1ae9fed0454cb390554e3ad0ef580e&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:15.390875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.449198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.449949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.450303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.450641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.467360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.469000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:15.495656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:15.496815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:15.497868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:15.504956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 267/534] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:15.509623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.597739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cec0c-a698-4bdf-814c-473b131e9fbf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.662048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6720f-01da-4809-aeea-c3beb6456dfb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.696555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.697728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.698210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.698406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.698914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.699017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.699267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.699542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.700232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.700582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.708537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.722958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.723249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 268/535] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:15.724232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.727782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.729540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:15.743374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:15.744349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:15.745219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:15.745219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:15.745219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:15.747305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 268/536] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:15.754183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.808880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.903373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907943ee-4a03-4057-8d75-efd8d5fc3de2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.958523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3750b-677e-490c-b718-07ebc5a8793e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.978412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.979035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.979322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.979601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.980345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=f9cdf8633c7740629b6956f631959f04) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.980754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.983457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.003333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 269/537] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/role_assignments?user.id=f9cdf8633c7740629b6956f631959f04&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:16.027147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.027147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.027147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.027503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.028098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:16.028401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.029850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.049939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 269/538] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:16.055932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.155394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:16.211606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0863-f173-4d19-8285-205140c3ee42 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.249587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.250230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.250508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.250790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.259023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.260586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:16.272460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:16.274555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:16.275745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 270/539] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:16.281406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.417951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:16.441004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f46f2-6641-4c8e-aa32-0b94ac3b4103 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.479960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.480978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.481462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.481951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.482841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:16.483360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.485136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d4ed7-adc7-4540-acab-2e72afc4ed42 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.498975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 270/540] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:16.505044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.523028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3fa0-ccfc-4d76-aa2b-6700c4c98199 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.523692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3fa0-ccfc-4d76-aa2b-6700c4c98199 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.524192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f3fa0-ccfc-4d76-aa2b-6700c4c98199 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.526027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 271/541] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:16.531725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.532306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.534190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.554467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:16.556008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:16.660538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3e61-755f-4d58-a46d-6fa38eebdc75 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.670601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 272/542] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:16.695701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.696445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.697616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.697616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.698333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=f8d65bfd6aed4083a04c5dc277cfb85f) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:16.698431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.700039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5d039-5299-495c-95e4-468c296ca6b4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.706799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 271/543] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/role_assignments?user.id=f8d65bfd6aed4083a04c5dc277cfb85f&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:16.707372 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.072115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.107216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c63a-104b-419e-a12c-e0c6936aba47 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.107777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c63a-104b-419e-a12c-e0c6936aba47 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.107777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603c63a-104b-419e-a12c-e0c6936aba47 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.110391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 272/544] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:17.118515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.118855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.119153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.152934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:17.154299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:17.184144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.251281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a26a2-6df8-4616-8358-93476cc055dd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.282469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 273/545] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:17.313417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.314777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.315087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.315369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.333428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:17.338258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:17.339226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:17.340084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 273/546] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:17.345771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.486999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd71a-05c8-4c84-ada0-7091505acaa2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.515399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.543328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.547657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.556498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 274/547] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:17.561976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.753410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b93653-7134-4b66-8c2e-0d04a8d39ad7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.803112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.808633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.809273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.809550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.809822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.826505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.833867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:17.848691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:17.850156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:17.851865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:17.851865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:17.851865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:17.851865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 274/548] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:17.855641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.867246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.990483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5db8-267b-477a-96b8-a633183862d7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.032253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.033431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.035243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.035796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.036776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:18.038270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.039858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.091966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 275/549] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:18.096076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190233a-8199-4f96-b087-78fa563b3b98 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.098571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.148080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.148754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.149034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.149307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.171555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:18.183154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:18.184211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:18.185170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:18.188708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 275/550] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:18.188885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.193095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.253019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.286611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5459-c38b-466c-b087-03213f1a01f7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.329151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.330529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.330811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.331153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.332686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66ef5-c412-4b99-b5de-b4f2fb58ec4f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.339211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.340751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e13b257b-76ff-4aae-b3a9-c73afb061cf2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:18.354915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:18.355894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:18.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 276/551] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:18.357570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8244d6-da61-4553-84e9-f887b29a1b1b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.358150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8244d6-da61-4553-84e9-f887b29a1b1b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.358150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8244d6-da61-4553-84e9-f887b29a1b1b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.359600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 277/552] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:18.369797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8244d6-da61-4553-84e9-f887b29a1b1b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.372458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.373208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.373485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.373808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.374492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:18.374785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.376606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ee65-3f73-4163-a387-65a025b48539 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.393737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 276/553] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:18.393737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.393737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.393737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.415910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:18.417553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:18.509203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.516847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8244d6-da61-4553-84e9-f887b29a1b1b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.531520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 277/554] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:18.532815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.577755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.585848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.588883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.588883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.588883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.588883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:18.589357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.591201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4d577-ef00-4fad-87a8-826890e97c4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.615016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 278/555] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:18.616202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72abd-0508-4ec8-81fb-f3b3caaf4b43 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.616561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72abd-0508-4ec8-81fb-f3b3caaf4b43 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.616842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72abd-0508-4ec8-81fb-f3b3caaf4b43 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.618217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 279/556] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:18.623249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72abd-0508-4ec8-81fb-f3b3caaf4b43 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.675252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614b518-eec7-400a-8b94-3b3faae4e0a9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.723377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.724823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.725376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.725850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.743007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72abd-0508-4ec8-81fb-f3b3caaf4b43 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.743442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.746490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-22bb8ec7-12d6-46a9-88cd-dc60f0166ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:18.767214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:18.768217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:18.769121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:18.769121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:18.769121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:18.772152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 278/557] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:18.774765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.775284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.775874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.788730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.789274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.789989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.790580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.803257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:18.805254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:18.825236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.878581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.879768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.902628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 279/558] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:18.903347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.923418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.023221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 280/559] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:19.023221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.026840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ae103-2f87-4a18-8adf-b21f616dcfaa None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.066011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.066718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.067049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.067325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.067970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:19.068277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.070702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.089671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 280/560] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:19.089671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.101453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.149454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c279-6449-4ee4-88f2-f1c8cf8386a5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.181118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.189688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.190427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.190680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.191051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.208913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef20-0b84-474c-8b90-465e5596acb6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.216327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:19.222295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:19.223313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 281/561] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:19.224795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.260382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.261181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.261538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.261890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.278582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.280147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:19.300223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:19.301517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:19.302544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:19.302544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:19.302544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:19.302544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 281/562] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:19.308019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.348149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d68d7-233c-44ce-9f3b-f817cd431956 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.373407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.390297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.390943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.391229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.391507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.401113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.402513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.414632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c7277-fb20-4329-aeca-4e1a2c2fcb6a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:19.415514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:19.416561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 282/563] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:19.417533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.445775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.453540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.454212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.454494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.459692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.465372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:19.471217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:19.472319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 282/564] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:19.473376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.525139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297e99-210c-49d4-b37f-15ace5d0942c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.561596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.562197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.562479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.562752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.563406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:19.563704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.565155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e728c5-8c14-451b-b908-def9a1516a20 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.573207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 283/565] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:19.574406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdeef-f259-4ce7-a61c-e912c56e50d9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.574687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdeef-f259-4ce7-a61c-e912c56e50d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.574956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fdeef-f259-4ce7-a61c-e912c56e50d9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.576147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 284/566] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:19.576862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fdeef-f259-4ce7-a61c-e912c56e50d9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.582386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81cae3-78f2-4fdd-9708-16a6ef88851a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.622283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.629528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.630146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.630425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.630698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.631343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:19.631641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.633060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.645931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 283/567] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:19.646816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.685210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fdeef-f259-4ce7-a61c-e912c56e50d9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.700217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.723527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.724160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.724444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.724752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.725505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:19.725819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.727285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.747684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 285/568] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:19.748479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.759494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9272b-4d83-4eeb-92d2-b7838bbd3623 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.795207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.795827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.796112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.796394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.797084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:19.797397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.799244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090f170-042d-4288-bfea-cf21313689ee None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.807856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 284/569] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:19.809118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.809411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.809685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.827580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:19.828812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:19.850245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:19.854430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1758f-8f92-4994-9aa0-007ce8cffd74 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:19.889090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:19.889767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:19.890044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:19.890317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:19.900217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 285/570] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:19.901104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.901650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:19.903109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:19.921204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:19.922384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:19.923261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:19.923261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:19.923261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:19.923261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 286/571] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:19.923545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:19.961439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.026633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969db9-ec84-4b64-83ba-df344adb3abf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.045846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fa4e-7a00-4716-a684-e61746eea84b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.065510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.066222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.069485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.070642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.077954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.080198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.082887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.083524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.083802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.084075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:20.092801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.093709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:20.094690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:20.098028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 286/572] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.099226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.101908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.103511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:20.119870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.121135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:20.122038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:20.122038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:20.122038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:20.122038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 287/573] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.122038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.124941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.216198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.218970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535a76-cf42-45af-aff9-a0612c402904 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.234293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb3cf-c29b-42d1-91b6-ee63af2f7413 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.252746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.253398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.253708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.253987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.264559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.266018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.272404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.273495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.274006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.274509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.275701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:20.276257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.277670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:20.281555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.282680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:20.288852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:20.288852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:20.288852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:20.288852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 287/574] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.288852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.291054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 288/575] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:20.291982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.422213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.460499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677c6ab-2502-4d21-bd86-ff8dc53a3d3e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.467111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154032-93cc-408f-9a1e-d910cf98a81d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.494151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.494915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.495300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.495676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.496429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:20.496870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.498348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.505225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.505835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.506113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.506389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.507078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:20.507383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.508824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.511192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 289/576] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:20.512017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.522411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 288/577] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:20.523479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.538033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.617329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dae2-4091-4ce4-8868-7c57673754e3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.633846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d42ff-0669-462c-9a16-472924836f0f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.640027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.656806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.659276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.659276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.659276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.669450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:20.671817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.672736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.673111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.673936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.674794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:20.674904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.675961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:20.677552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:20.678192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.678280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 290/578] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.678358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.678429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.692144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 289/579] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:20.693034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.776672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.790124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce82aca-804c-4e24-bc0a-4a52adfb3a95 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.812883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12133a55-8431-4e8f-b676-a1e1921ab873 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:20.831516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.832274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.832660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.832935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.843095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.844614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.853632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:20.854273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.854554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.854828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:20.857985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.859161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 291/580] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.860211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.867087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:20.868607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:20.884185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:20.885384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:20.886564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:20.888678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 290/581] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:20.889924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:20.910943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.980823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a90232-cc4e-4c22-b16d-87d0edd204b3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.007039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266a64f-3f5e-4694-821b-9eb72852c098 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.019438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.020027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.020312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.020625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.021379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b60fd9fbd81e403e8b22b8204eb92dfc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.021782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.023219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.029251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 292/582] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/role_assignments?user.id=b60fd9fbd81e403e8b22b8204eb92dfc&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.030029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.044191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.051084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.051729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.052009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.052282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.053027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.053359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.054764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.067357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 291/583] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.068682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.169508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bc883-c28d-4dde-95f8-874e854cfa86 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.179237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.194953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01f70-e6aa-4dfc-9cfe-74cbe4e4f94b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.216642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.217394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.217673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.218554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.227435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.228968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.237905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.238553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.238795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.239067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.239910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.240175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.241636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:21.242950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:21.244110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 293/584] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:21.245597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.266105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 292/585] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.266953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.355043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.407467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb87a4-7ea6-4821-b85d-0f6bc00fe6d7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.407677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f76f4-9125-4464-aa09-bb5c6b8ac6b5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.444015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.444792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.445074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.445342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.447340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.447963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.448242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.448533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.449365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.449679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.451141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.459139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.460623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.470021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 294/586] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.471251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:21.476248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:21.477419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:21.478326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:21.478326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:21.478326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:21.478326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 293/587] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:21.478622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.505705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.590960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bf4f-1d33-4144-aafc-29a24d489b22 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.595456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf93d4c-c012-46e1-b80f-c17d1d1e4a3a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.599307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.635647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.636173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.636454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.636757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.636946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.637490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.637588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.637796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.637901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.638118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.639226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.651433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.653014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.658867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 295/588] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.660206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:21.672332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:21.674468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:21.675833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:21.675833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:21.675833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:21.675833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 294/589] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:21.676079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.770573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.790333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd51b75-7e0f-43df-a3d6-300c017bc471 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.791009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aab773-71dc-4cfb-a0d4-576345fadb34 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.828587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.829260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.829561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.830031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.831251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.832111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.832598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.833073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.833997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.834303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.835757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.845936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=171bca600dcb4dcba12c02fb3dc67197, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.847397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.851429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 295/590] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.852283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.871430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.941369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 296/591] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:21 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:21.942335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.974084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd2f3-dbff-4899-b886-a7505f79ca35 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.021018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.022186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.022689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.023191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.035816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.037994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:22.055235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:22.056263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:22.057290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:22.057290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:22.057290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:22.058837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 296/592] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:22.059942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.096542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9cf8f-baba-428f-801c-8b7db9f17bb0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.138459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.156065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.156726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.157005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.157280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.157998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:22.158446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.159753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.168380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.176423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 297/593] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:22.177399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.182179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0aa45-333c-485e-b43e-35948826f279 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.224093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.224805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.225158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.225595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.233958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.235271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:22.247976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:22.249704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:22.250892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:22.251691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 297/594] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:22.252587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.329221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe215-8f07-4f72-9776-d01599041cfb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.380200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.381741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.382189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.382630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.383439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:22.383858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb4ec-92e4-4151-aa01-41b5704e8265 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.384085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.385815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.402255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 298/595] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:22.403738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.415466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.428846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.430243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.430679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.431118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.442455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.445035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:22.465834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:22.466823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:22.467735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:22.470895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 298/596] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:22.472395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.476868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.535232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951c140-1bcd-4535-ae91-bc42e002f7a0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.578569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.579352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.579758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.580381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.581345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:22.581345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.583650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.605544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 299/597] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:22.606963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.666706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4a20-f118-4c84-90d4-b963a4883d05 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.706196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.707209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.707644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.708112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.716198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.718103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.731837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d6583-48f8-4218-8638-806451547a29 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:22.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:22.733766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:22.734666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:22.737295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 299/598] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:22.738419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.749070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.774597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.775446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.775856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.776205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.777029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:22.777413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.779021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.794208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 300/599] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:22.795354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.799965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:22.860250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995dd7-ea02-4234-8d7f-a1621e74ad9f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.899109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.900221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.900729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.901192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.914458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.916319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.918721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a5127-2060-4013-b332-d39a13c9c506 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:22.932727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:22.933754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:22.934682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:22.934682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:22.934682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:22.936891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 300/600] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:22.937997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:22.961392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:22.961971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:22.962259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:22.962542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:22.963412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:22.963725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.965413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.981171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 301/601] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:22.982315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:23.020010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.057156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.061614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28875555-f831-4096-af2d-7183c4d99969 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.099167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3be35-4337-48b5-878a-3a51c7a44f81 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.100175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.101238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.101802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.102298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/5b1ae9fed0454cb390554e3ad0ef580e/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.119246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=5b1ae9fed0454cb390554e3ad0ef580e, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.121109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:23.137618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.138458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.138747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.139021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.139722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:23.140080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.141529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:23.160891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 302/602] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:23.160891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:23.216279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 301/603] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:22 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/5b1ae9fed0454cb390554e3ad0ef580e/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:23.218567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:23.328283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.340310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071dbe4-a5a9-4a38-bdea-c395b43c2627 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.383464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.384417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.384852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.385213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/f9cdf8633c7740629b6956f631959f04/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.391273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2dd87-f806-4013-813d-ff7813dd5d5e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.405375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=f9cdf8633c7740629b6956f631959f04, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.406996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ffcb-c262-47df-afd5-33dd1f3f0875 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:23.433682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.434384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.434715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.434990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.443293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.444794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-51edb04f-8b93-44fd-8e7f-28afd7459255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:23.458021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:23.458972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:23.459858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 302/604] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:23.460836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5e8f-ba70-46a7-88b2-ce6d1a9c6bdd None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.460836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5e8f-ba70-46a7-88b2-ce6d1a9c6bdd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.461009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5e8f-ba70-46a7-88b2-ce6d1a9c6bdd None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.462543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 303/605] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:23.465384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c5e8f-ba70-46a7-88b2-ce6d1a9c6bdd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:23.478877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.511475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 303/606] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:23 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/f9cdf8633c7740629b6956f631959f04/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:23.513100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.513673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.514164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.551567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:23.556207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:23.651365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c5e8f-ba70-46a7-88b2-ce6d1a9c6bdd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.696818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 304/607] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:23.718152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.719125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.719479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.719856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.720765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:23.721135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.722724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:23.745794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 304/608] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:23.752075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:23.831242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.864051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15190bf-ae18-4814-8c6c-b72fe432d854 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:23.901104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:23.901823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.902048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.902318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/f8d65bfd6aed4083a04c5dc277cfb85f/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.919518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=f8d65bfd6aed4083a04c5dc277cfb85f, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:23.921115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:24.029059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:23 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/f8d65bfd6aed4083a04c5dc277cfb85f/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:24.041706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:24.171589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:24.218176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2019b5-bd35-45df-a74f-5d932d7d9fbd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:24.263081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:24.263740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.264026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.268419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.276614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:24.281744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:24.282761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:24.283603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 305/610] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:24.291762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:24.435148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31b92-b7c6-490d-9a7f-cb9c9a64395a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:24.461294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:24.473486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:24.474119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.476201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.476201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.476201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:24.476201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:24.477023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef9353-bc3f-4f2c-953c-242f44c59b89 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:24.488177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 306/611] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:24.493771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:24.517612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a575-3f1b-424b-a0b2-724a94145dca None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.517926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a575-3f1b-424b-a0b2-724a94145dca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.518168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a575-3f1b-424b-a0b2-724a94145dca None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.519810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 307/612] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:24.525357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.525641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.525919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.554214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:24.555427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:24.695240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 308/613] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:24.702782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628186-0b16-4bdf-900d-af6e4db50730 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:24.757002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:24.765419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:24.766003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.766539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.766822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.778988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:24.780499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:24.804099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:24.805376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:24.806347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:24.806347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:24.806347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:24.806347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 306/614] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:24.811588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:24.954354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1023539-015f-4b2d-a99e-84b4ff8434ee None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:24.971303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:24.996155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:24.996860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.997150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.997425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.998081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:24.998385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:24.999833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:25.013254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 309/615] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:25.018712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.168328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc11654-558c-4af6-94ee-d678f75a1224 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.218441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.225345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.226008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.227090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.227316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.245249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:25.248120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:25.271796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:25.272856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:25.273797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:25.282581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 307/616] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:25.287839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.380904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.422218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaf20-21e2-48dd-86f3-7e4dfcd614d0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.505498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.506168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.506409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.506688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.509383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2c34a-bdc7-42ce-a7c6-d517421b6f40 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.534803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:25.544805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:25.545891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:25.546858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:25.553901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 310/617] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:25.557790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.608197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.608926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.609213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.609488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.610251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:25.610559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:25.612826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:25.616444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.667146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 308/618] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:25.672312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.694414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f151-b0f2-4f97-afbf-3b32ab7aef33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.756986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.757990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.758483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.758965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.759853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:25.760478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:25.761912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:25.776756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 311/619] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:25.783914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.847674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.851730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809882-73c3-44bb-8b34-db19b15b6324 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.916901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.917826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.918112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.918378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.928291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.935635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb1bb7-452c-4b84-95f3-e285d172737b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:25.942887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:25.945784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e2b92ec6-b0c8-4f4e-a485-242b249a23bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:25.968378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:25.969446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:25.970581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:25.970581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:25.970581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:25.974593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 309/620] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:25.975638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2b87-70f9-46dd-b291-4d22c4b06a2f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.975917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2b87-70f9-46dd-b291-4d22c4b06a2f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.976182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a2b87-70f9-46dd-b291-4d22c4b06a2f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.981698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 310/621] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:25.982591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2b87-70f9-46dd-b291-4d22c4b06a2f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.988776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:25.993235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.994200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.994757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.011115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.012477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-067108d9-a9eb-49ec-8336-030eb6ef753a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:26.037065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:26.038144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:26.039076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:26.039076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:26.039076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:26.039694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 312/622] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:26.041708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.044010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.044010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.074690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:26.076083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:26.146078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a2b87-70f9-46dd-b291-4d22c4b06a2f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.163686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 313/623] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:26.164840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.201565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.202693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.203177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.203676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.209433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:26.209837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.211482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.239260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 311/624] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:26.244299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.284232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.292666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.324178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483774e1-73a7-4428-8532-3dadb61bfba7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.368356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.370298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.372121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.372599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.374471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:26.377411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.379322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.403629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 314/625] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:26.410752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.498077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ad84-1822-4591-9387-8f303d0c0a97 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.540574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.541325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.541711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.542098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.552054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.553822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:26.568320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:26.569609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:26.570737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:26.572176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 312/626] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:26.573416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.600317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715c793-c633-48f8-b287-9416ba3e93cf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.644120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.645138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.645635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.646151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.656195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.658772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.661119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.666374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:26.676199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:26.677557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:26.678674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:26.680612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 315/627] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:26.681653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.706995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665997eb-4121-4d9a-9a80-6f72f6223ecd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.746614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.747613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.748083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.748468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.763928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-2771d144-b2e3-4f22-9f30-cb8a6f375fef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:26.775130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:26.776230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:26.777103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 313/628] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:26.778504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1cf6-fa8b-44e6-bb8e-8c840d973b9c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.778924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1cf6-fa8b-44e6-bb8e-8c840d973b9c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.779328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1cf6-fa8b-44e6-bb8e-8c840d973b9c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.781320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 314/629] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:26.782102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1cf6-fa8b-44e6-bb8e-8c840d973b9c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.809091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9029793-1900-45d2-b982-4541d810f9d5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.846256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.846866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.847151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.847425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.848123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:26.848427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.849979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d0388-a6e1-47f0-bd6d-87544006ea19 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.863258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 316/630] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:26.864851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcaaf-7c84-4181-a1f3-694f0b7206f3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.865142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcaaf-7c84-4181-a1f3-694f0b7206f3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.865419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcaaf-7c84-4181-a1f3-694f0b7206f3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.868933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 317/631] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:26.871501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fcaaf-7c84-4181-a1f3-694f0b7206f3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:26.906127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1cf6-fa8b-44e6-bb8e-8c840d973b9c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.943032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.943724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.948488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.949144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.949430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.949717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.950457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:26.950771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.952226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfffc94-7296-45c4-89ba-0d0540862b57 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.974506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 315/632] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:26.975838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7e0d-1808-4288-9d64-e6a6e1d6d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.976131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7e0d-1808-4288-9d64-e6a6e1d6d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.976407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f7e0d-1808-4288-9d64-e6a6e1d6d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.000476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8d3f7e0d-1808-4288-9d64-e6a6e1d6d4e5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:27.002533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8d3f7e0d-1808-4288-9d64-e6a6e1d6d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:27.139065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fcaaf-7c84-4181-a1f3-694f0b7206f3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.139065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.139065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.139065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 318/633] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:27.139427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 316/634] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:27.139874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:27.170548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737e87-4ad4-4db0-8831-22fda7a0880e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.176916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 317/635] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:27.178227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.198364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.213905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.214560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.214842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.215116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b60fd9fbd81e403e8b22b8204eb92dfc/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.232004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=b60fd9fbd81e403e8b22b8204eb92dfc, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.233376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.240978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.289402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4994a-ae45-40df-814b-f6c9df889be3 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.325117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.325739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.326023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.326299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.363379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 319/636] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:27 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b60fd9fbd81e403e8b22b8204eb92dfc/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:27.364650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.411163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.413419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.500767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.506792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bdcee-2ff6-42c9-9e37-3166f23b3aaf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.560045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.561187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.561658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.562462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.578306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 318/637] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:27.579295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.581355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.583516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:27.602007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:27.603412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:27.604306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:27.604306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:27.604306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:27.604306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 320/638] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:27.604306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.636776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.715559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e40c-ded6-4cc2-a784-d8a6374b1fdc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.741216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33416d-0d50-46fd-b451-6a1d0b28059a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.765578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.766612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.768330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.768809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.782835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.783891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.784367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.784877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.785346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:27.791639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:27.792692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:27.793669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:27.794313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 319/639] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:27.795355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.801044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.802561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.810805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:27.819356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:27.838614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:27.839733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:27.839733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:27.839733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:27.839733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 321/640] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:27.839733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.937151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.942310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548578e0-6fa5-474b-8864-f0db6961c051 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.966040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec199-34c0-43d4-8319-308084f575e4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.986481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.987221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.987506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.987782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.988431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:27.988768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.990157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.003650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 320/641] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:28.005366 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.011844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.012500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.012810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.013084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.026253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:28.032153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:28.033268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 322/642] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:28.037987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.095305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.136159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cac271-1e19-4da0-8441-98cf3e332f5a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.155119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd63741-aaec-41e6-9b08-2b5cfd76c9b7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.180541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.181121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.181401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.181672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.182341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:28.182644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.184016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.197196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.197848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.198122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.198401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.199109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:28.199461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.200881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.203114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.203986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 321/643] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:28.210233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.225869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 323/644] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:28.227270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.348470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c231e9-b8cb-48cd-bfa7-946f9fe7ce9d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.382252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc7514-360d-464c-bf32-76fe88fb68b0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.383949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.392998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.393956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.394240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.394515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.402470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.403941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:28.416590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:28.417882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:46:28.418984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:28.421250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 322/645] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:28.422349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.427980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.428914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.429411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.429879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.430756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:28.431266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.433016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.450315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 324/646] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:28.450315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.514868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.543486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597157bd-2a3f-4e8a-959b-a3219c883f3a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.564958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bf6fb-2bed-44c0-b07c-8b7099cd35b1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.582642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.583528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.583805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.584189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.602705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.604253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.623785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.624811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.625274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.625726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:28.629376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:28.630303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:28.631240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:28.631240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:28.631240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:28.631240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 323/647] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:28.632184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.644866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.646347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:28.659229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:28.660176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:28.661108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 325/648] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:28.661868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.693149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.764656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2995-109d-470c-8e4d-77a3e1a1f6b1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.798813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94a97-eddc-4eea-901d-be7a8c4227ff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.804359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.805005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.805290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.805566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.806301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:28.806617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.808074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.818201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:28.832113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 324/649] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:28.832113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.847876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.848540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.848908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.849183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.862148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.864210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:28.881060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:28.882117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:28.883036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:28.883036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:28.883036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:28.883036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 326/650] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:28.883036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:28.957547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4da89-5abd-4c35-ac4e-29c75746d3d3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.959482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.003727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.004455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.004764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.005046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.005695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:29.006001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.007496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.012277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c932-5b15-4463-bb27-3e79e8af9a94 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.025724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 325/651] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:29.026580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.059484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.060016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.060303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.060606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.061309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:29.061649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.063253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.086129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 327/652] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:29.094633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.135491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.157885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72183d42-7ce9-4e1f-afb8-c2704e102946 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.197562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.198196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.198475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.198750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.224707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f6a5e-bf46-4d7c-8db4-cf2e948a3ddc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.234149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.265674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.266302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.266589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.266862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.267825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:29.268408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.269883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.278032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.282612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.289760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 328/653] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:29.289760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.391700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.406237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976872c-92eb-45b7-ae90-8906fd2fe26f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.406762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 326/654] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:29.408126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.452235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.453039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.453258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.453478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.461455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.462897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:29.475634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:29.476659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 329/655] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:29.477767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.488989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.533249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d57b-3960-447e-afd6-1cb4c4c6ad7a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.569937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.570559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.570825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.571098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.571817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:29.572123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.573596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.584549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 327/656] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:29.584549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.605200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b39f5-5078-4538-9127-4829fa464f0c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.649202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.649863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.650214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.650553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.662263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.663796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:29.677938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:29.679171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:46:29.680366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:29.683607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 330/657] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:29.684653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.699642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.747605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed65e6-2c0f-4812-a519-62940a1ebe8e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.782315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.794186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.795106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.795402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.795678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.810365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.813619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.818865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24210e41-b0e3-46d0-8c93-0f93e7960829 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:29.830507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:29.831655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:29.832595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:29.832595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:29.832595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:29.832595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 328/658] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:29.833250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.863339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:29.864188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.864474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.864791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.865537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:29.865843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:29.867310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6843e4-f5a2-4f6a-97fb-4b950d402e99 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:29.888354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 331/659] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:29.889973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b39a-1596-4299-81c3-97e24e11a257 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:29.890267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b39a-1596-4299-81c3-97e24e11a257 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:29.890590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b39a-1596-4299-81c3-97e24e11a257 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:29.891956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 332/660] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:29.893541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b39a-1596-4299-81c3-97e24e11a257 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:29.971750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:29.981178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1f0e0-679d-46e5-81ca-256affb74d5e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.014587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b39a-1596-4299-81c3-97e24e11a257 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.022947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.023626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.023905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.024177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.025075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:30.025378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.026809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.049838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 329/661] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:30.050712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.061605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.062694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.062986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.063318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.064985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:30.065340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.066880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f5ba-737f-418d-b0ff-a382b5ec7c0b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.080939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 333/662] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:30.082221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.082519 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.082799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.098830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.104108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:30.105439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:30.176429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4a94-6529-4c05-b0c2-cd77707e0ec1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.190032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 334/663] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:30.190719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.218937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.221585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.222358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.223070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.293908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.316599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.318380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.359064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49c164-0c47-4724-9046-0995e38c141b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.370347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.414604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.415340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.415688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.416027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.462809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 330/664] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:30.463783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.514195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.515973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.575066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893518-82e3-4a0a-99ab-7993a030ad26 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.577748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.616243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.617615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.618177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.618637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.623141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.630827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.633386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.642736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 335/665] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:30.642736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:30.654335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:30.656104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 331/666] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:30.660370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.773236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a885265-37f5-4ba7-a305-c282250dfca2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.810184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d251e3-54a6-4c73-a229-4b96c1158aae None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.810448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.810919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.811197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.811469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.823156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.824695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:30.841863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:30.842938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:30.843883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:30.843883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:30.843883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:30.843883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 336/667] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:30.844754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.857568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.864991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.865633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.870127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.870127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.877290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:30.882535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:30.883513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:30.884405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:30.888575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 332/668] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:30.889452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.956968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.971202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5dc26-cfa1-4841-bb51-c52e98874973 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.999660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c23d-8f4c-4a77-ad4e-548ab5074085 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.013428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.014080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.014371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.014648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.028017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.029351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.039931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.040769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.041054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.041328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.042028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.042332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.043771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:31.044576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:31.045540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:31.046427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:31.046427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:31.046427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:31.046427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 337/669] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:31.046708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.065767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 333/670] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.065767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.123148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.167920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137bfaa-5b36-4ad3-bd13-bcc55a22f29e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.170019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c25e4-6f72-4135-a819-31f2d11b719a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.186907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.206016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.206799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.207150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.207493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.208640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.209732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.210164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.210478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.210826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.211167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.211879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.212308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.213834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.219416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 334/671] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.220316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.236954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 338/672] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.237780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.336257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1626f-1c00-4517-917f-e2b60ac110fd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.354961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13ce0-55bc-4f13-9a9e-04ec1d914e8d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.375952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.378331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.379164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.379445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.380066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.381013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.381318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.383358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.390036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.390684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.390936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.391255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.392707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=5b1ae9fed0454cb390554e3ad0ef580e) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.393177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.394653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.398471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 335/673] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.399614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.405571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 339/674] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/role_assignments?user.id=5b1ae9fed0454cb390554e3ad0ef580e&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.406895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.468152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.550051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656ad-7b2f-4a67-be43-6ce558cd2596 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.557991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1edf8b-6b93-4238-b8d0-d79e1a830c4f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.600095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.601788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.602240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.602942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.607677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.608481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.608877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.609225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.613050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.614512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.622226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.623264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:31.629399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:31.630390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:31.631412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 340/675] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:31.631966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:31.649491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:31.651381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:31.653246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:31.653246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:31.653246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:31.653246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 336/676] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:31.653246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.708162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.802412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.807981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce84e0-744d-49ce-ad74-16f0f2d13089 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.823981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521815-8dc3-4118-ae61-6932568e191c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.849307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.850078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.850558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.850894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.859592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.861967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.872654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.873639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.874104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.874570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.875606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.876117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:31.876643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:31.877625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:31.879271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 341/677] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:31.879853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.881630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.900795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 337/678] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.902269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.027012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e53e4-5889-4b15-a8b6-019c97ad6b18 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.029854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.035108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dd83b-bd1b-42b2-ad9e-5ca3599a6fbe None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.071059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.071889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.072272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.072694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.073517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:32.073943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.075562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.080330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.081074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.081352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.081628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.082353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:32.082712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.084268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456a92c-874f-49bc-9d71-677584f15e0a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.089812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 342/679] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:32.091353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.105133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 338/680] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:32.105133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5118-8f22-4578-b51e-fd321c90380e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.105133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5118-8f22-4578-b51e-fd321c90380e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.105133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5118-8f22-4578-b51e-fd321c90380e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.107453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 339/681] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:32.108698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5118-8f22-4578-b51e-fd321c90380e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.123847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.222369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f9b7-c7f4-4fa1-a10a-42770adf3ddd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.231925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5118-8f22-4578-b51e-fd321c90380e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.264755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.265469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.265811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.266150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.267028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=f9cdf8633c7740629b6956f631959f04) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:32.267644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.272734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.276030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.276934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.277300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.277652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.288009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 343/682] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/role_assignments?user.id=f9cdf8633c7740629b6956f631959f04&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:32.289515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.295320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.297462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5e2e4fe2-4579-4b67-b39d-ced2e74dc07b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:32.316534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:32.317752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:32.318957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:32.322720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 340/683] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:32.324804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.325247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.325762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.338011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.354384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:32.367758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:32.438425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6381a-2947-47b9-b0d0-32557c442667 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.460878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.466390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 341/684] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:32.468033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.489800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.490435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.490725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.491355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.492190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=f8d65bfd6aed4083a04c5dc277cfb85f) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:32.492495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.493972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.504098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 344/685] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/role_assignments?user.id=f8d65bfd6aed4083a04c5dc277cfb85f&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:32.620458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925f43-2c75-43f0-bed9-cd9a53c92fd6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.664428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.665106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.665373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.665647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.666385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:32.666695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.668158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.691054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 342/686] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:32.696390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.812533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.822899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24093911-f268-4c92-91f1-c70bc5793aa6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:32.836768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:32.866637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:32.867626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:32.868135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:32.868743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:32.926878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.962409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:32.964686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:32.991665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b8785-6ed8-404c-bc00-ddb5f73ceecc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.046835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.047961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.048571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.049268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.072811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:33.088543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:33.091098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:33.092043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:33.092994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:33.096263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 343/687] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:33.101232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 345/688] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:33.105856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.105973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.258068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2d5c-84f8-498c-8134-7e72dc0e934c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.294676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.295330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.295613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.295884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.317341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:33.318919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd772a8-33a3-4dfe-9af1-e326d579372f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.319064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:33.341399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:33.350610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:33.358142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:33.359093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:33.359093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:33.359093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:33.361430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 346/689] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:33.361546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.362290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.362423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.362852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.363219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.363912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:33.364216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:33.365857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:33.376816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 344/690] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:33.385634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.446607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.554603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596248b2-a0ef-4acd-9e42-3a1dace06d50 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.554782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcc7e-877c-47f2-bebb-a9c27d669f64 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.596006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.596772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.597058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.597333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.611286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:33.613361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:33.631117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.631751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:33.631864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:33.632843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:33.633748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:33.633748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:33.633748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:33.633935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.633935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.633935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:33.633935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:33.634166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 345/691] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:33.638640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:33.643655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.667921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 347/692] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:33.675685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.728309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.832634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff343d2-e894-40a3-bbaf-ad6b960b352b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.834457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.871529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.872306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.872624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.872904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.882127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:33.884253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:33.898166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:33.899141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:33.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 348/693] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:33.906389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:33.931182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b69f-a84c-4e01-8017-0a60f7eaca12 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:33.997866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:33.998588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:33.998876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:33.999152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:33.999802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:34.000106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.002173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.022792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 346/694] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:34.028569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.030695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2bee2-2e42-48af-91fd-fe762ef7bcdc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.072849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.073499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.073797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.074066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.074756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:34.075060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.076749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.091002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 349/695] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:34.097813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.127875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:34.199043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:34.210311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cdc1c-4d6c-4da1-88d5-10a3979a2674 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.225246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de4688-e33d-4296-914c-6ef225c5ba8b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.250796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.252307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.252735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.253108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.260966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.262653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.266564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.267962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.268262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.268559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.269308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b60fd9fbd81e403e8b22b8204eb92dfc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:34.269621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.271062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-78f41c87-7ab0-4561-8005-5413e0729971 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:34.276542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:34.277579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:34.278553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 347/697] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:34.280256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126b4-3939-4f1c-8e9c-e4efa94c0688 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.280683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126b4-3939-4f1c-8e9c-e4efa94c0688 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.281064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126b4-3939-4f1c-8e9c-e4efa94c0688 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.285087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 350/698] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/role_assignments?user.id=b60fd9fbd81e403e8b22b8204eb92dfc&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:34.286156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.287811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 348/698] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:34.289841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.290131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.290413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.310256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:34.311539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:34.410281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:34.423292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230499-1552-4ccb-91a1-8d0a3340861a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.463328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.464064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.464355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.464667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.465677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:34.465997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.467533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.475229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 349/699] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:34.488228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 351/700] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:34.494126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.587088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:34.607962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f9c2-4840-4f7e-9fe9-5a9fc95e0cf1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.659416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.660475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.661004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.661478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:34.748303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:34.750585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:34.756143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.872070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:34.903754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45539-38cd-4230-98f6-e1b53d29d5cb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:34.910807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 350/701] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:34.916440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:34.978631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:34.979338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:34.979624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:34.979897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.002699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.004174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:35.024477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:35.025531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:35.026557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:35.026557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:35.026557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:35.026557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 352/702] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:35.026557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:35.032524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.088746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e603-fc94-4620-b857-381cbfda561a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.172316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:35.174063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.174813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.178209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.203446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.205463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:35.242722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:35.244216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:35.245391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:35.245391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:35.245391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:35.250257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 351/703] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:35.254728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.265810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81e93-f6d9-4ce0-b27f-72e1b03636d9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.307854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:35.317346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:35.317984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.318267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.318553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.319220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:35.319526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.321017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34456af-ccce-4a50-bf7a-df415a557eb3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.339306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 353/704] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:35.340772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602610-e2e8-44e6-a9a9-5bbe0df71ad2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.341069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602610-e2e8-44e6-a9a9-5bbe0df71ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.341353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602610-e2e8-44e6-a9a9-5bbe0df71ad2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.343192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 354/705] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:35.344042 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602610-e2e8-44e6-a9a9-5bbe0df71ad2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.387888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c9f0-b465-4c0b-a6dd-4f8259661ad7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.419157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:35.426832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:35.427391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.427676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.427955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.428633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:35.428943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.430381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7612c58-8b36-491c-a0ba-23f88c27aeea None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.444964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 352/706] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:35.444964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8350e-1eeb-4fb6-b690-0193c3310d43 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.444964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8350e-1eeb-4fb6-b690-0193c3310d43 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.445297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8350e-1eeb-4fb6-b690-0193c3310d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.458998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602610-e2e8-44e6-a9a9-5bbe0df71ad2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.464166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7cd8350e-1eeb-4fb6-b690-0193c3310d43 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:35.465414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7cd8350e-1eeb-4fb6-b690-0193c3310d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:35.497068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:35.497684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.497965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.498244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.498897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.500345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.537820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 353/707] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:35.538927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fa09-23df-4b73-a469-b11e7534e9b9 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.539222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fa09-23df-4b73-a469-b11e7534e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.539504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fa09-23df-4b73-a469-b11e7534e9b9 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.544568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 354/708] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:35.544568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2fa09-23df-4b73-a469-b11e7534e9b9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.579934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:35.662433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2fa09-23df-4b73-a469-b11e7534e9b9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.696931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:35.697486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.697764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.698033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.705083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:35.706531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b2d0730b-403f-4bbb-9207-034441a4ab1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:35.717662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:35.718657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:35.719578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:35.723656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 355/709] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:35.724725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:35.725008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:35.725276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:35.745305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:35.746573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:35.817560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 355/710] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:46:35 2022] POST /identity/v3/users => generated 254 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:46:35.818898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.826704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 356/711] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:35.843228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:35.895425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:35.959676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6deff50-5982-4adc-aee8-a8e324f7710e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:35.977689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:36.009539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.010175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.010454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.010736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.011448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.011754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.013312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.042297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 356/712] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:36.049801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.104724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb7b7-9e66-4074-bd35-5798bf92d73c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.155137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.156660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.157165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.158238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.159066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.160763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:36.173901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:36.175342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:36.176610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.177963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2bf34-ffdf-4d6a-85fb-f2fc5cba36f0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.179498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 357/713] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Sep 8 13:46:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:36.180603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.224273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.224858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.225233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.225513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.226358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.226669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.228159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.235056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 357/714] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:36.236036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.297539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:36.326697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47a60-72c7-4ce8-b24d-43b4bc4c5a5b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.328898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:36.386151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.387020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.387397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.387768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.388576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.390920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:36.402276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:36.403592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:36.404544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:36.405301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 358/715] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:36.418026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.484259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3f0c-e3fc-444c-9e81-1878692f62fa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.531233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.533877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.535220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.536286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.537494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.537809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.539220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.555787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 358/716] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:36.570233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.631752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9fddb-59bc-4440-baff-53e26075f1e2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.679593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.680826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.681114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.681396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.682041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] RBAC: Adding query filter params (name=network) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.682349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.683805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.690445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 359/717] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:36.695985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:36.707379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:36.829969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ad0d-4462-4eec-9a06-34ffc0426faf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.835083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9755b6-63cf-478f-8214-c376ac2c2c33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:36.841450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:36.896369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.897016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.897294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.897567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.898208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] RBAC: Adding query filter params (type=network) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.898511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.899890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa65c3b-3860-4c84-b6db-db18b3d96f27 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.902637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:36.903267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:36.903541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:36.903810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:36.904447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:36.904776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:36.906218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944f50f-2a83-4c3d-97e0-e7183d0a7bc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:36.916852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 360/718] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:36.917302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 359/719] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:37.204744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa336-a4f3-4b03-9a7c-edbd043104d0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:37.205613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa336-a4f3-4b03-9a7c-edbd043104d0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:37.206151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa336-a4f3-4b03-9a7c-edbd043104d0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:37.207968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 361/720] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:37.213923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:37.214579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:37.214579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:37.249165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:37.257547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:37.349540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 360/721] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:37.703428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa336-a4f3-4b03-9a7c-edbd043104d0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:37.801887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:37.846638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa336-a4f3-4b03-9a7c-edbd043104d0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:37.903694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:37.904426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:37.904734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:37.905007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:37.923416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:37.933616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:37.934640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:37.935471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 362/722] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:37.944077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:38.086586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:38.095984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22e93a-9e05-4dc4-beb0-476f20dcb7d0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:38.138972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:38.139650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.139937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.140210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.140917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:38.141225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:38.143424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:38.156550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 361/723] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:38.162935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:38.313385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99866fa5-143e-496f-a49e-6c31509c3246 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:38.354496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:38.364464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:38.370467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.370467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.370467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.379328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:38.380819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:38.400591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:38.402397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:38.403625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:38.403625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:38.403625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:38.403625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 363/724] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:38.410620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:38.547113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce6be-59c9-4dc7-a51f-5beac13d2ba4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:38.607284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:38.607690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.607978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.608317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.609043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:38.609404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:38.611363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3dd0f-e429-4d48-a5de-f003d6cc7f5e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:38.632065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 362/725] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:38.637278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:38.780027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90a64-baae-4a57-b0a5-e845362ea9e7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:38.831983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:38.832686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.832977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.833255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.846232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c0be-6c6d-4ef2-96db-f402720e2d32 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.846566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c0be-6c6d-4ef2-96db-f402720e2d32 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.846811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1c0be-6c6d-4ef2-96db-f402720e2d32 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.848561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 363/726] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:38.848879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:38.850580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:38.855994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258b6a-f488-40c3-830c-fb2c1d966c5e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:38.856338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258b6a-f488-40c3-830c-fb2c1d966c5e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:38.856583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258b6a-f488-40c3-830c-fb2c1d966c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:38.869084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:38.870102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:38.871954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 364/727] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:38.877009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:38.898036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d7258b6a-f488-40c3-830c-fb2c1d966c5e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:38.901130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d7258b6a-f488-40c3-830c-fb2c1d966c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:38.933351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:38.984836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:39.056639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 364/728] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:46:39.058331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5daec-d14a-4625-a664-e5046466b48c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.058623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5daec-d14a-4625-a664-e5046466b48c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.058893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5daec-d14a-4625-a664-e5046466b48c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.067732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 365/729] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:39.069403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.069689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.069963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.081031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3caffb-e5d1-40bb-80ef-c253e45e5f10 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:39.115033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:39.116242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:39.124097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:39.125399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.125939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.126446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.127385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:39.127903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:39.130004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:39.152502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 365/730] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:39.158217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:39.282322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c7c7-0a6c-40cd-8df4-864b0a77dbd2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:39.300947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:39.350022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 366/731] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:39.359656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:39.360350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.361483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.361716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.379894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:39.444028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:39.446330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:39.566672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:39.571270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 366/732] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:39.578361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:39.582498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:39.631592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50851f0-6039-4b11-9b9b-e0a42a05bfcf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:39.729000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:39.729791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.730149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.730495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.730804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505245dd-c36c-415d-b256-1c2268277eaf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:39.742786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f3f5452d-d727-4dda-b038-6e625cc587e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:39.747968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:39.749422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:39.750447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:39.756450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 367/733] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:39.756450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0295da-ae27-41f3-ae8c-1c31d504a45b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.756450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0295da-ae27-41f3-ae8c-1c31d504a45b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.756450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0295da-ae27-41f3-ae8c-1c31d504a45b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.759648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 368/734] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:39.761276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.761638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.761993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.784017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:39.785550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:39.787182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:39.787846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:39.788380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:39.788691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:39.802253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:39.803861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:39.818586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:39.819581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:39.820587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:39.820587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:39.820587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:39.820587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 367/735] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:39.821581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:39.868336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 369/736] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:39.873533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:39.882561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:39.945475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c2ee-efea-4965-a9ad-a7f6880640cf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:39.972815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.006280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.006897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.007176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.007479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.008555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:40.008873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.010247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.015464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae31f-84fa-4999-9465-9badd44c9a42 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.020103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 368/737] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:40.021002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.060434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.061107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.061394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.061670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.073766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-91ab9667-e71c-4485-b4c8-5602aac26138 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:40.079037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:40.080376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 370/738] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:40.085873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9a2a-6743-4ec1-8008-8479b7f8f6fc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.086673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9a2a-6743-4ec1-8008-8479b7f8f6fc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.086673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9a2a-6743-4ec1-8008-8479b7f8f6fc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.088658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 371/739] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:40.089483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9a2a-6743-4ec1-8008-8479b7f8f6fc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.138679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e6c3a-558d-410f-9a26-74313d7b1ab7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.154174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.176567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.177193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.177510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.177754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.178418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:40.178724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.180129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.195583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 369/740] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:40.196428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.215661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9a2a-6743-4ec1-8008-8479b7f8f6fc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.242687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.252835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.263719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.263719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.263719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.264627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.266096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-11a01921-cedf-489a-9ce9-fb861291bace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:40.280398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:40.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:40.282430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:40.282430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:40.282430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:40.282430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 372/741] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:40.282870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.283218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.283513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.303668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:40.304919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:40.309633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229ff32-5571-48b7-bd0e-b8b26d64f489 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.348391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.349042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.349352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.349625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.350298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:40.350603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.351973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.361263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 370/742] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:40.362274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.385201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 373/743] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:40.386075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.399376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.472411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b79338-d4d2-4cd7-8f29-39605eda5488 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.506719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444365-cca8-45bf-9b1c-f5c77c67135c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.508882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.509502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.509788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.510066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.510728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.512110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.522384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.547797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.548666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.549066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.549219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.555914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.557394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:40.568955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:40.569928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:40.570911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 374/744] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:40.572442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.659853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 371/745] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:46:40 2022] POST /identity/v3/services => generated 251 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:40.661269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.685165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5881-1998-42cd-a74b-9d44cd8d54aa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.755784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.757540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.757969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.758690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.759695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:40.760025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.761735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.778371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 375/746] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:40.779252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.808100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.816345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc5fd8-d4a6-48d4-a9ca-7ce14826d0a4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.832676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:40.856421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.857331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.857943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.857943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.871634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.873260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:40.889653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:40.892233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:40.893481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:40.893481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:40.893481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:40.893481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 372/747] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:40.894436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:40.910648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16f794-a3ab-4f9c-8035-9e02e0075d01 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:40.956015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:40.956791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:40.957071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:40.957343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:40.958046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:40.958352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:40.959803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:40.978029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 376/748] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:40.978941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.012235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427943-fef8-40d8-930f-bd126dfafef5 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.051291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.052043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.052328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.052643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.053334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.054786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.079100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.098988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e937-70a4-42ac-abd7-9b87dd5b2d9e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.133744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.134383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.134677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.135212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.143878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.145366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.156463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 373/749] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:46:40 2022] POST /identity/v3/services => generated 240 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:41.157379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:41.159256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 377/750] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:41.160328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.161344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.176549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.300972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81250df-1f09-4f82-b833-cc68eac24ba2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.313692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd74d9c-a95d-4930-90b4-e385832c0810 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.342579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.343506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.343856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.344204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.345534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:41.345918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.347413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.358104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.358851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.359230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.359655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.360487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b60fd9fbd81e403e8b22b8204eb92dfc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:41.361024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.362558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.367869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 374/751] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:41.368847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.372842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 378/752] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/role_assignments?user.id=b60fd9fbd81e403e8b22b8204eb92dfc&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:41.373730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.394556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.461937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.511577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95353f12-3eeb-49e2-9451-a901d8d39e64 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.525969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1730-5374-4d8d-81c2-b46a98061fe9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.557111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.557806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.558090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.558381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.559116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:41.559423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.561581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.571394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.572505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.573006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.573273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.582397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.583978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.586596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 375/753] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:41.596553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:41.603027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:41.604009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:41.605216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:41.608611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 379/754] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:41.613138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.712448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.740470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618efec-9d1a-42a4-b653-cf211aebc512 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.778685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.779533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.780021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.780468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.781733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:41.782048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.783606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.812116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 380/755] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:41.813446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:41.932015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36109ba-bbb1-4371-9c85-1a5fbe970cdd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.935039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f41053-5237-4c46-9b65-0d154fa1e882 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:41.960241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.969551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.980178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.980864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.981232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.981522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:41.993286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:41.994859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:41.995248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:41.995490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:41.995773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:41.996057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:42.015138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:42.022760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:42.023656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:42.023656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:42.023656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:42.023656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 381/756] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:42.023656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:42.140549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8fd7-20a4-411e-8cd8-06ab07c39ef2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:42.149424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:42.151390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:42.192634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:42.193281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:42.193562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:42.193820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:42.194482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:42.194784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:42.196186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:42.231507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 382/757] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:42.238943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:42.340298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 376/758] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:42.347060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:42.408995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:42.480859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:42.523835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94794-7b00-4176-a6b4-db7e4f2d7bf1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:42.587198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:42.588473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:42.589046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:42.589531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:42.603649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:42.605931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:42.614629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718547be-761f-43af-918c-d8ef88118e9f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:42.636473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:42.637549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:42.638481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:42.638481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:42.638481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:42.645510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 377/759] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:42.651763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:42.712992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:42.715234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:42.716001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:42.716788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:42.731940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:42.735275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:42.760414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:42.762114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:42.763904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:42.769839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 383/760] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:42.776360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:42.869427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:42.949967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d89da-64f0-4742-bea7-fe26b4f84d21 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:42.958624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407402a-0e1c-46de-984a-ae55213ed4de None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:42.965111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:42.997069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:42.998149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:42.998643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:42.999226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.000232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:43.009141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.011221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.019055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:43.020194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.020194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.020194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.023846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:43.023846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.023846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.030297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 384/761] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:43.036392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 378/762] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:43.037384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:43.041833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:43.202300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae24c-8e80-49fe-91ae-3113717399d1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:43.279355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08347b6-7c7f-4a12-b9c0-219916e5e17f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:43.305717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:43.306325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.306610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.306890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.312258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=171bca600dcb4dcba12c02fb3dc67197, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.313740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4067e-82d5-49c6-bbec-bd73702b27db None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.331410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:43.332103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.332407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.332715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.334836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:43.340415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.342046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-00d59003-5e02-4bbb-9b11-85d391ed9b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:43.354286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:43.355963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:43.356994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 379/763] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:43.357480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be21b27-8123-43dd-81fb-a43db2372968 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.357480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be21b27-8123-43dd-81fb-a43db2372968 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.358238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be21b27-8123-43dd-81fb-a43db2372968 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.364582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 380/764] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:43.364582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be21b27-8123-43dd-81fb-a43db2372968 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:43.413068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 385/765] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:43 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:43.415279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.415878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.416887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.444824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:43.447117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:43.473337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:43.559443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be21b27-8123-43dd-81fb-a43db2372968 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:43.591022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 386/766] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:43.632969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:43.633950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.634415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.634910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.635842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:43.636348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.638066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.653163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 381/767] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:43.659774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:43.780769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e028f-e955-42af-bcc4-8f5fe26591d2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:43.827250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b04706-4894-4664-ae81-05469029578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:43.827801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04706-4894-4664-ae81-05469029578f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:43.828087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04706-4894-4664-ae81-05469029578f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:43.828366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b04706-4894-4664-ae81-05469029578f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:43.829197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b04706-4894-4664-ae81-05469029578f None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b0c4bdc0bd494a61b889dc79354b3f2d) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:43.830044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b04706-4894-4664-ae81-05469029578f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:43.831888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b04706-4894-4664-ae81-05469029578f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:43.838448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 387/768] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:43 2022] GET /identity/v3/role_assignments?user.id=b0c4bdc0bd494a61b889dc79354b3f2d&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:43.965967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.011311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8612f-08fb-4ad1-b82b-6c4f89d662e2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.012162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8612f-08fb-4ad1-b82b-6c4f89d662e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.014051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8612f-08fb-4ad1-b82b-6c4f89d662e2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.016660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 388/769] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:44.026679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.027396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.027906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.052582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:44.065701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:44.067283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:44.085745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:44.118709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653834f-6322-442a-b070-cbdc85de71c8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:44.192923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:44.193832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.194267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.194692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.195513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:44.197086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e1aa0a73-9bd6-4876-9037-5011d47c9135 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:44.212750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:44.214022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:44.215092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:44.217524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 382/770] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Sep 8 13:46:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:44.218860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356127c1-3751-4807-9e18-89e30e7a03bd None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.219297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356127c1-3751-4807-9e18-89e30e7a03bd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.219725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356127c1-3751-4807-9e18-89e30e7a03bd None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.221275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 389/771] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:44.222368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 383/772] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:44.225705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.229573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.230101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.230584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.263300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:44.269130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:44.404244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 384/773] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:44.409760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950527d4-b749-4313-b355-8ba0ef652cb0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:44.470781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:44.473821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.476368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.476880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.478858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:44.479384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:44.481174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:44.486985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 390/774] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:44.494209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.514535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.537204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:44.728767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:44.730772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f01e3-a54b-484e-bdbf-2ea74a6230f1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:44.787219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:44.788607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.789134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.789674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] PATH_INFO: `/v3/services/network` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.790950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:44.791537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c119a-164f-4a89-9348-05c282854a9d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:44.793573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:44.815400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:44.816656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:44.817687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:44.825736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 391/775] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:44 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:44.827691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.830271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:44.831201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:44.831539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:44.831874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:44.832638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:44.833017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:44.834479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:44.840757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 385/776] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:44.841784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:44.936981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:44.983422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432676-ed97-4d91-a13e-d38051bafa0a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:44.984845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af9464-c223-42e7-bc35-164459f23fe4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.000123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:45.027055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.028082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.028441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.028787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.029468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] RBAC: Adding query filter params (name=network) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:45.029773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.033165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.036839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.037769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.038052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.038328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.047608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 386/777] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.047608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.060436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:45.069117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:45.070094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:45.071021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:45.079075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 392/778] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:45.079075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.195987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f528de-323a-4cb1-880b-1f25caf4cd5b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.233988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.234971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.235504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.236692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.237482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8411-a79c-4323-be35-89b1ab9811b8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.237854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] RBAC: Adding query filter params (interface=public, service_id=b5dd81445828489295ac3d1d12ad74b0, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:45.238380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.239963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.248723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 387/779] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/endpoints?service_id=b5dd81445828489295ac3d1d12ad74b0&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.249798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.304900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:45.310852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.312614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.313057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.313481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.318949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:45.318949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.318949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.320866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:45.324270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 393/780] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.325502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.404246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a71511-afd8-4bd5-b598-35085ca39b52 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.454440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.456305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.456952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.457452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.458572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:45.459087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.461687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.474857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 388/781] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.476074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.490047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25199193-20ac-4f26-805c-f8b85ff786d2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.534153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.534767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.535141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.535479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.536176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.538130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.549903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 394/782] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.549903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.676075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:45.682901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a595-85c3-4d25-b824-65a1c1ffa971 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.689599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:45.779786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5947cee-f138-4a5f-92d8-501322e2cec0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:45.789088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.790057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.790566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.791042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.791955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] RBAC: Adding query filter params (interface=public, service_id=c2600c5260a141bc8745e93efad06ffc, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:45.792470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.794185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.803460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 389/783] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/endpoints?service_id=c2600c5260a141bc8745e93efad06ffc&interface=public®ion_id=RegionOne => generated 194 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:45.820016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:45.864531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:45.865985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:45.866271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:45.866549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:45.890165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:45.891648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:45.909031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:45.910073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:45.910986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:45.910986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:45.910986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:45.910986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 395/784] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:45.916249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:46.062852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05999a6-d8e1-4e8c-9390-89cd1b43fbe9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:46.086544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1a5f-d52b-4bd7-a47f-9dbf8ca4cb4e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:46.107295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:46.130279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:46.131066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.131343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.131617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.132665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:46.132975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:46.134372 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:46.150838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 396/785] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:46.156659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:46.169138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:46.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.170161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.170435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.172229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:46.174346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b0e6-43cf-4dd2-8d6f-255d53e7b0fc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:46.183962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 390/786] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:46:45 2022] GET /identity/v3/services => generated 772 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:46.185341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aadef-c78e-4388-afed-1b5bfca83b79 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.185626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aadef-c78e-4388-afed-1b5bfca83b79 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.185901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6aadef-c78e-4388-afed-1b5bfca83b79 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.187425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 391/787] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:46.202297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428a6e-6103-4e3e-95b0-efb979f93530 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.202928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428a6e-6103-4e3e-95b0-efb979f93530 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.203417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b428a6e-6103-4e3e-95b0-efb979f93530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.243782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6b428a6e-6103-4e3e-95b0-efb979f93530 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:46.249081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6b428a6e-6103-4e3e-95b0-efb979f93530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:46.308411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:46.379251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991863e-92f0-4487-8d48-2ed843d5df26 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:46.436981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 392/788] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:46.477573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:46.479154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.479945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.480737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.484852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b787b0-9471-4bd9-ab0c-88cbaea66bec None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.485717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b787b0-9471-4bd9-ab0c-88cbaea66bec None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.487528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b787b0-9471-4bd9-ab0c-88cbaea66bec None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.491227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 393/789] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:46.497947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:46.498790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.499189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.499571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.500310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:46.519710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:46.521005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:46.522274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:46.524950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 397/790] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:46.533130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:46.533130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:46.534563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:46.575595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:46.633472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 394/791] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:46.691379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e466-54d0-4f52-8821-86554508b06d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:46.734225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:46.735145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:46.735945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:46.736413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:46.737587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:46.738053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:46.739690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:46.761174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 398/792] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:46.769838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:46.868231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:46.976922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:46.997815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42528-f7fc-4545-b6f2-b02b090ddaba None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.041757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.043103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.044015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.044372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.045627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.060103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.061602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.062039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff64ec-e3c6-45a5-b4d9-58e4830e1fe9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:47.080611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.082018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:47.082934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:47.082934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.082934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:47.082934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 395/793] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.087496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.109283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.111493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.112058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.112609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.127141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:47.133687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.134649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:47.135506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:47.138469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 399/794] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.139501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.234138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b66dc-881c-45a5-aced-5e65da411d79 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.257905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809f193-a6a9-4288-9975-8e394d82cc57 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.285868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.286769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.287517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.288032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.296323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.297124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.297410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.297691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.299155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:47.299504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.300985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.302639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:47.308237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.309233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:47.310082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:47.318580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 396/795] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.320234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 400/796] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:47.320795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.321263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.324074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.335454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.445128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad5be-a6f1-403b-9d81-eec3fab06645 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.452741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d359-217e-4764-af8a-d3eb80cb260b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.486312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.486878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.487366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.487551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.496153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.496862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.497721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.498288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.498856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.499345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.500399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:47.501060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.504082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:47.511970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.513048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:47.514045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:47.517085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 401/797] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.517989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 397/798] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:47.518185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.523274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.597629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.603448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.641116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88731b24-4d9d-4ba5-8208-13430f0574d2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.641810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428980-8831-4314-9b6d-781304b34fd9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.680857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.681104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.681741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.682137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.682441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.682747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.682958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.683345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.683849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:47.684251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.684559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:47.685014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.686004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.686730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.696929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 402/799] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:47.698129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.708663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 398/800] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:47.712080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.820796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67df3b-dcb6-44de-a68f-de3a5c105771 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.834686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2eae72-3c2c-4824-8b72-96411bd70585 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:47.856111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.862544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.868201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.868201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.868201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.869073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:47.878947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:47.879410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.879781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:47.880134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:47.880674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:47.881833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.893378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:47.895097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:47.899861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.900942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:47.901851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:47.901851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.901851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:47.908824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 403/801] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.913964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:47.915193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:47.916123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:47.917074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:47.917074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:47.917074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:47.917074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 399/802] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:47.917315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.033830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c364b-8632-47b7-972d-8ef938cab86d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.037785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4521c-e3c5-4064-9042-46303c43200d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.074348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.074924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.075207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.076197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.076307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b60fd9fbd81e403e8b22b8204eb92dfc/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.076400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.076400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.076400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.077010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:48.077314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.077980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=b60fd9fbd81e403e8b22b8204eb92dfc, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.078688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.080078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06bb3f-c208-404f-8aed-298008225d1a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.093628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 400/803] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:48.097078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.134645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:48.201761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecfa6-4cb8-4c2a-b854-55e69d18ba55 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.202144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 404/804] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:47 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b60fd9fbd81e403e8b22b8204eb92dfc/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:48.214009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1f73-82dd-4b64-b601-2a14ad852779 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.214390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1f73-82dd-4b64-b601-2a14ad852779 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.214576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c1f73-82dd-4b64-b601-2a14ad852779 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.216555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 405/805] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:48.216926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c1f73-82dd-4b64-b601-2a14ad852779 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.251542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.252240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.252610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.252891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.253572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:48.253879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.255327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23591d-e5e7-4b36-9169-ba64e2792206 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.276479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 401/806] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:48.278480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.278922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.279207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.311157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:48.314345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:48.315827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:48.390896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c1f73-82dd-4b64-b601-2a14ad852779 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.439753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.440935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.441605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.441605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.455110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.457231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.461549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 402/807] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:48.464031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:48.479889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:48.481966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:46:48.482980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:48.486627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 406/808] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:48.488219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.559844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:48.732144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba121c4e-2d55-4a73-915b-42eb9fb93605 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.736698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:48.743387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217554-05b6-482c-9110-5c3123cc25bc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:48.788987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.789613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.789894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.790165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.790935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:48.796572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.796572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.824560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 407/809] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:48.828545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.829671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:48.830805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:48.831694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:48.832677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:48.851838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:48.853893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:48.870339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:48.871409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:48.872360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:48.876982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 403/810] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:48.890619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:48.977083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36304df5-ffa3-41ea-a246-43b2c4d5656c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.028316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.029619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.030375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.030861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.039062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.060137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f132-8c39-44e6-a202-703e8b2de51f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.083962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.107715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.109016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.109239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.109522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.110272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:49.111090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.114111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.140146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 404/811] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:49.141350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.161195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.164129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6c87-468e-4dc6-bacb-384779f5600e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.311158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b246cc-8434-4bbe-a7fe-b5625c33ffe8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.321218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 408/812] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:49.323985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91e87-3089-475d-a6b1-00498faaf101 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.324761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91e87-3089-475d-a6b1-00498faaf101 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.325349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c91e87-3089-475d-a6b1-00498faaf101 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.328279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 409/813] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:49.330997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c91e87-3089-475d-a6b1-00498faaf101 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.362494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.363411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.364012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.364761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.365991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.368746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:49.381932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:49.383996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:49.385379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 405/814] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:49.386420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.411492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.437989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.502578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c91e87-3089-475d-a6b1-00498faaf101 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.553851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaf9f9-6779-46ff-b8e4-ef1c831d4717 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.557490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.559399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.559706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.559957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.582842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.584333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.606820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.607809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.608239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.608726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-179f7bb7-beda-4e7f-9460-bffe597ccca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:49.610261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:49.611588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:49.612561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:49.612561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:49.612561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:49.618061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 410/815] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:49.619526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.619878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.620121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.631563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.634061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.646222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:49.647458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:49.663774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:49.668635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:49.671313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:49.671313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:49.671313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:49.671313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 406/816] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:49.671313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.768967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.769975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 411/817] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:49.771124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.836072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006dccf-e8b6-4067-9b51-bfc1f89eeebf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.851730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:49.885112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.885787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.886661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.886941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.889157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:49.889495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.890889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:49.909025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 407/818] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:49.910994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:49.930864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3053135-b7dc-45f2-95f5-5349c8fdc4ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:49.977751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:49.978804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:49.978804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:49.979249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:49.980000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:49.980472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:49.982757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.006108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 412/819] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:50.007533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.070550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad58693-80fa-4367-b5d0-7dd1e4573876 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.100219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.116034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.117282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.117788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.118187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.119441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:50.120022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.122817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.146943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 408/820] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:50.149205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.190703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f038ab-99ac-4524-ac4d-e7406df113a1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.195224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.235398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.236244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.236558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.236903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.237481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:50.237782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.239179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.244975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 413/821] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:50.245834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.315671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139c334-1021-40e4-9fe3-ad3d7a3010d6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.362996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.363581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.364032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.364477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.375644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.378277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:50.398773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:50.408400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 409/822] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:50.409936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.414760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e662d-9b02-49c0-ab7f-7532fa24c4bd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.461335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.462294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.462530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.463035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.463562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] PATH_INFO: `/v3/services/network` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.464662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.466430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:50.478136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:50.480698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:50.481556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 414/823] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:50.482367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.530202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.545320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbbdda-a04d-45b0-83a6-99e0eb656a3e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.599857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.601011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.601508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.601993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.612726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.614267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:50.629693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:50.631076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 410/824] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:50.632860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.648795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87d5f-6fcd-4d8f-a00f-d37f74ee512b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.700788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.701719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.702153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.702565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.703544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.706995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.770585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb55e-2d20-4038-b5a2-69aed1e73d29 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.773334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.809680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:50.810335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:50.810618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:50.810893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:50.811652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:50.811961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:50.813578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:50.826189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 415/825] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:46:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:50.827373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.827923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 411/826] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:50.828829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:50.951757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:50.961968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf7c68-a8dd-40d5-882f-8c3cb9fa7a20 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:50.984406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92a57b-a593-47fd-8f98-87fa110c25e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:51.027377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.028435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.028956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.029435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.030709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:51.031240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.033777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.034047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.034405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.034687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.034970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.035610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:51.035910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.037611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2f5b-a349-489f-b9b1-b5909540ef42 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 416/827] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511f45-03ea-4106-a1ca-658c6adca786 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511f45-03ea-4106-a1ca-658c6adca786 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511f45-03ea-4106-a1ca-658c6adca786 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 417/828] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:51.051135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511f45-03ea-4106-a1ca-658c6adca786 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:51.057898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 412/829] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:51.058796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:51.092836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:51.248121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76fb61-c5b2-422f-8b7a-4f373f959928 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:51.265785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511f45-03ea-4106-a1ca-658c6adca786 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:51.309799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.310793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.311279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.311766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.313021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] RBAC: Adding query filter params (type=network) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:51.313562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.316216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d93a4-e86d-4128-8c3f-0f1e4d21e259 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.330255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 413/830] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:46:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:51.330255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.330255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.330255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.336048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.337206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.337702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.338170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b0c4bdc0bd494a61b889dc79354b3f2d/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.359420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:51.361523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:51.365194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=b0c4bdc0bd494a61b889dc79354b3f2d, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.367839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.473671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:51.491386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 414/832] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:51.491386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:51.491968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 418/832] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:51 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b0c4bdc0bd494a61b889dc79354b3f2d/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:51.496556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:51.535887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:51.692850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493709f6-972b-4780-a7af-d9cf6105f50f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:51.719693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0747c-8d6c-43d2-af9c-3beb22292c3e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:51.765259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.765879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.766159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.766424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.767974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:51.768209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.769705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.778986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 415/833] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:51 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:51.795774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:51.796786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:51.797281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:51.797764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:51.799236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:51.801974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:51.924105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 419/834] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:46:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:52.176161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:52.347993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:52.382472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c4757-6186-4619-8a57-ad3bf8492b77 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:52.463514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:52.464439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:52.464976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:52.465468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:52.485890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:52.496781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:52.497822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:52.498681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:52.499387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 416/835] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:52.508817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:52.635055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:52.698658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819a628-2fe3-4c08-8f57-8b93ba90fb88 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:52.740673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:52.741599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:52.742083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:52.742526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:52.743394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:52.743874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:52.745510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:52.756585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 420/836] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:52.765688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:52.939332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c39e1-668f-4015-a424-23ce98fba4c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:52.985530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:52.986891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:52.987402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:52.987738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:52.996085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:53.001583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:53.003528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:53.020687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:53.021947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:53.023078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:53.023078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:53.023078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:53.024996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 417/837] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:53.034613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:53.167985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb886-cd3c-4f1b-8141-e4ab30db1e88 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:53.187091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:53.209232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:53.210257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:53.210539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:53.210825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:53.211497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:53.211807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:53.213299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:53.227636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 421/838] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:53.237343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:53.428305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d13205-62b5-450e-8be7-041728f0b856 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:53.493889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:53.494985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:53.495480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:53.495980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:53.511668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:53.514380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:53.537524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:53.539334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:53.542356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 418/839] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:53.554998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:53.718778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b49ee-9824-4225-b347-3bedd63b42dc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:53.785573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:53.786630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:53.787121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:53.787861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:53.789331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:53.789898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:53.792968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de06a0f-70ef-43fc-b981-dd99583a08c7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:53.831018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 422/840] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Sep 8 13:46:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:53.837113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:53.929629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a04e-5a79-4a31-a328-cdef2a9f7e84 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:53.929997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a04e-5a79-4a31-a328-cdef2a9f7e84 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:53.930230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a04e-5a79-4a31-a328-cdef2a9f7e84 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:53.931882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 423/841] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:53.938492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:53.939415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:53.939866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:53.961476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:53.962721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:53.985621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:53.995460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:54.048767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 424/842] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:54.060560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6f73-5a94-4d23-a014-5ce00d578325 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:54.131456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:54.132466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.132987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.133670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.269735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:54.272299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:54.335862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:54.413264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:54.449301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 419/843] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:54.457928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:54.512552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e00f2-d489-4210-ba4e-efe05468d1b7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:54.575267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:54.576628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.577092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.577549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.578864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:54.581735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ac81a98d-158e-4c01-b511-aa9024dde94d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:54.596690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:54.599615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:54.601619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 425/844] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:46:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:54.603873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72098-ffac-4527-8092-a74064a9adbd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.603873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72098-ffac-4527-8092-a74064a9adbd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.603873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72098-ffac-4527-8092-a74064a9adbd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.611751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 426/845] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:54.611751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d72098-ffac-4527-8092-a74064a9adbd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:54.654412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:54.680777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6c22-dd0a-47c5-a7d7-edf7b695df24 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:54.733820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:54.734764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.735344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.735844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.749589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:54.752439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:54.764627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d72098-ffac-4527-8092-a74064a9adbd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b875f378-1c44-4f5a-8f42-ba7453e4b53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:54.792048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:54.794223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 420/846] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.796929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.797624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.804781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:54.821581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:54.823834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:54.837469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:54.838097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:54.838536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:54.839000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:54.839918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:54.840229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:54.842025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:54.854116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 427/847] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:46:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:54.854116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:54.916451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 421/848] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:54.917633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.021144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.034956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86e29-0e1c-472a-9084-b61d5cb236c1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.051777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99e810-4dab-40a7-a995-1fd8f26c6834 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.081860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.082487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.082765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.083038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.084393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:55.084744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.086261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5d45a-4501-48d0-b630-cfad250df743 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.099142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.104751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 428/849] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:55.106447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962747-1a54-4693-88e5-230c469ba8d6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.106732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962747-1a54-4693-88e5-230c469ba8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.118373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45962747-1a54-4693-88e5-230c469ba8d6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.118595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.118595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.118867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 429/850] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:55.118991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.118991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.119225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45962747-1a54-4693-88e5-230c469ba8d6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.119347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:55.119347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.119347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee4479-78bf-421f-b8d8-e00c4ee135f4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.123709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 422/851] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:46:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:55.126201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.127850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.128618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.161373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:55.164076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:55.273882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 423/852] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:55.275181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.351355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45962747-1a54-4693-88e5-230c469ba8d6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.408208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.408891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.409173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.409479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.417601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.419063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.425864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd88eea-1392-4e17-8fb5-2dedc0be6bd4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:55.432045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:55.433294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:55.434485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:55.434964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 430/853] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:55.441834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.465130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.479840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.497973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.499416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.500120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.500805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.523764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:55.535999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:55.538404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:46:55.540361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:55.547066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 424/854] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:55.557085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.600554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e2d-7e79-49fb-b326-f9ed74759361 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.639528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.640084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.640444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.640928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.641640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:55.642288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.643490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.657970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 431/855] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:55.667870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.743953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94064c29-86f1-4912-bfbb-3011d42f781c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.779000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.809366 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.810450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.810925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.811393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.812556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:55.813058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.816179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.834688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fe75f-4558-421e-95f5-b70bfb117535 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:55.836979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 425/856] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:55.838468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:55.909045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:55.926087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:55.927097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:55.927625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:55.928027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:55.929429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b60fd9fbd81e403e8b22b8204eb92dfc) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:55.929962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:55.932305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:55.944206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 432/857] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/role_assignments?user.id=b60fd9fbd81e403e8b22b8204eb92dfc&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:55.945716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.019225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5bbd-c1b0-4a11-bce1-1b2745115987 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.074795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.075577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.075936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.076288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.077043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.078759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:56.090731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:56.092756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:56.094643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 426/858] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:56.099621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.170512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dabc81-3d7a-4147-b81b-33735519f010 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.226737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.227912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.228316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.228607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.240847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:56.248474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.252324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:56.285047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:56.286144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:56.287071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:56.287071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:56.287071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:56.288126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 433/859] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:56.294872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.299838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de541a-3ea5-4710-9e2e-ac9c6474b7ab None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.323489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:56.363523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.364164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.364444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.364744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.365416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:56.365898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.367436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.373598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 427/860] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:46:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:56.385282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.489552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf606-4f1f-4448-a5cc-c47771f7ad37 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.542849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.543487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.543772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.544047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.544742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:56.545049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.546507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.553238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefe63-1761-4329-aa4b-342766f68188 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.573326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 434/861] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:56.579122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.613557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.614730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.615018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.615300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.615966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:56.616280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.618545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.625900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 428/862] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:46:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:56.671449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:56.747593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828b48-cef3-4996-8aca-6530362af528 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:56.793571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:56.794401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:56.794754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:56.795075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:56.805568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:56.807326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:56.820848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:56.822760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:56.824704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 435/863] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:56.837162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:56.917640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:57.003409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a168-1c6e-4b12-8469-fd5352f84b71 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:57.041514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:57.042156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.042445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.042714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.043418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:57.043723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:57.045194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:57.073346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 429/864] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:46:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:57.078961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:57.199722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dea17-48ca-49a8-bc9d-b9612bc6cd39 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:57.210562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:57.240089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:57.240718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.241009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.241313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.318716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:57.320230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:57.431843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 436/865] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:57.441736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:57.555910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:57.561107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea460e0b-8be2-429a-89b4-5bbedac0a054 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:57.601511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:57.602076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.602361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.602644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.613605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:57.615124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:57.634157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:57.635407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:57.636548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:57.636548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:57.636548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:57.638731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 430/866] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:57.649855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:57.661837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:57.774753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f41110-5c3c-4dcc-8629-f6a2706d2b5b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:57.814742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:57.815594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.815882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.816221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.816919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:57.817228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:57.818611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488270f-7314-4c8a-afe4-545fa5316a25 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:57.832717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 437/867] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:57.838708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:57.877005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e793-d986-42d2-8666-643bb3a4b6a3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.877199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e793-d986-42d2-8666-643bb3a4b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.877767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e793-d986-42d2-8666-643bb3a4b6a3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.879637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 438/868] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:57.885122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:57.885469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:57.885751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:57.907992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:57.909718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:57.980895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b24576-c696-4d18-b71f-b926a8945ad6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:57.991796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:57.998993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 439/869] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:58.029514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:58.030161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.030499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.030785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.039357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:58.041055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:58.053648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:58.054617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:46:58.055521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 431/870] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:58.061233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:58.181623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a099f2-7c99-4081-943e-96569afb2c20 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:58.222997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:58.224167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.224711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.225195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.226136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:58.226651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:58.228378 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:58.243776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 440/871] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:58.250829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:58.273001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:58.353494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:58.410424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777ac4-6e8f-44a1-bf89-67630be4d71a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:58.424196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:58.450646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:58.451787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.452358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.452881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.453913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b0c4bdc0bd494a61b889dc79354b3f2d) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:58.455164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:58.456941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a7a43-713a-433d-98ad-91b31910f655 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:58.464629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 432/872] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:58 2022] GET /identity/v3/role_assignments?user.id=b0c4bdc0bd494a61b889dc79354b3f2d&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:58.477030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5149876-dc07-4b04-80dd-25ac1151bdb1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:58.555168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:58.555168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.555168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.555168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.555601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:58.556996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c0eb-ae65-44b7-8189-dfa8e4a92a53 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:58.656920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfdae4-6ba5-48aa-8b96-fda4fb5cd094 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.658454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfdae4-6ba5-48aa-8b96-fda4fb5cd094 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.658454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfdae4-6ba5-48aa-8b96-fda4fb5cd094 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.660687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 433/873] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:58.668565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f703b1-9821-4d8f-916d-c2f61782e471 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:58.668565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f703b1-9821-4d8f-916d-c2f61782e471 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:58.668565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f703b1-9821-4d8f-916d-c2f61782e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:58.687581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e3f703b1-9821-4d8f-916d-c2f61782e471 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:58.690266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e3f703b1-9821-4d8f-916d-c2f61782e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:58.695175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 441/874] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:46:58 2022] POST /identity/v3/services => generated 251 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:46:58.851387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:58.860042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 434/875] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:59.080087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711cb2e-5108-4be8-ac1f-dff6cb94e123 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.082806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711cb2e-5108-4be8-ac1f-dff6cb94e123 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.082806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711cb2e-5108-4be8-ac1f-dff6cb94e123 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.083349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 442/876] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:59.089937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.090583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.091082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.111017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:59.112633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:59.151420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711cb2e-5108-4be8-ac1f-dff6cb94e123 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:59.206648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 435/877] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:59.291799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711cb2e-5108-4be8-ac1f-dff6cb94e123 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:59.312109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:59.333796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:59.334967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.335487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.336109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.337455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:59.339403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:59.351124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:59.352192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:46:59.353077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:46:59.356040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 443/878] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:46:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:59.362748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:59.478318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da5b37-d243-4134-b49d-029680b6afc9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:59.511530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:59.518441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:59.519399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.519852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.520293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.525555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:59.525555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:59.525555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:59.529197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 436/879] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:46:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:59.535497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:59.536837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:59.686956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bdb3d-e7d7-493e-804d-75c96654cb51 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:59.702010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25001c2-e68f-4604-8fd0-63ddf7bde2da None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:59.734561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:59.735164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.735428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.736235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.737441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:59.737758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:59.740032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f644e-8041-4480-8851-aaadec894985 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:59.752977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 444/880] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:46:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:59.755746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:59.757337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:59.757914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:59.758483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:59.759542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:59.761283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9293-0bb6-4533-87ed-849f60aeadee None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:59.958864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 437/881] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:46:59 2022] POST /identity/v3/services => generated 269 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:47:01.168522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa716c-5e8f-480a-8097-7d2e68ce38d1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.169056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa716c-5e8f-480a-8097-7d2e68ce38d1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.169056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa716c-5e8f-480a-8097-7d2e68ce38d1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.170658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 445/882] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:01.176799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.177656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.178171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.181996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed31ee-c4d2-42c4-84ed-1a52a7c5f221 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.182286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed31ee-c4d2-42c4-84ed-1a52a7c5f221 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.182564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed31ee-c4d2-42c4-84ed-1a52a7c5f221 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.184140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 446/883] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:01.190112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.190399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.190677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.202961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:01.205392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:01.209146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:01.210213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:01.260274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:01.272968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:01.295856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 438/885] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:01.296629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 447/885] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:01.569267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:01.572783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:01.680670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa38546-f11f-49e9-96d4-e29d1bc0489a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:01.692030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf86bf-9a1f-448f-8ddd-851517820ad3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:01.718969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:01.719739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.720667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.721292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.721963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:01.723331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:01.733689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:01.734773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:01.736473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:01.740602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 439/886] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:01.742466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:01.743359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.743469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:01.743905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.744384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.759597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:01.767309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:01.768781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:01.769840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:01.778108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 448/887] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:01.779419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:01.807295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:01.825838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:01.867168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4e0ce-4b1b-46ac-b3c6-980f62ab4579 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:01.911928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:01.913290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.913722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.914004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.914805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:01.915122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:01.917151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:01.918431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b46ea-d590-4518-a388-a870fda618a8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:01.929669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 440/888] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:01.931131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:01.968730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:01.969623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:01.970192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:01.970742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:01.971799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:01.972214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:01.973957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:01.989305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 449/889] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:01.990278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.056907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67445aa-67ae-4037-b1f9-dfa122de8e5d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.072922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.098372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.099328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.099835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.100353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.101283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:02.101806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.103444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.111060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 441/890] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:02.113266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.116979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.120960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa04aa-5b65-493f-a6f4-dd5d6846d071 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.169425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.170125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.170420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.170631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.183343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.184827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-967e9d78-7507-4e1e-8617-80ae7bc8abfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:02.201514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:02.202555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:02.203466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:02.203466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:02.203466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:02.203466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 450/891] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:02.204426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659477-2d8c-405f-959d-7fbdfec14225 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.205312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659477-2d8c-405f-959d-7fbdfec14225 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.205813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659477-2d8c-405f-959d-7fbdfec14225 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.207253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 451/892] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:02.208431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659477-2d8c-405f-959d-7fbdfec14225 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.249419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e68a9b-3cca-48b8-9a7e-1289c337300d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.286423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.287343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.287882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.288159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.288901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] RBAC: Adding query filter params (interface=public, service_id=4919c51791b24a509ed8a7aa826f9276, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:02.289213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.290595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287b2b-4110-499d-87dc-324ff7b00e41 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.295706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 442/893] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/endpoints?service_id=4919c51791b24a509ed8a7aa826f9276&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:02.297821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.298452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.298735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.317733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:02.318947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:02.319503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659477-2d8c-405f-959d-7fbdfec14225 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.357500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.358041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.358321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.358596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.359249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:02.359553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.360302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.361803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9bf67-9c03-4234-8490-cc2da4e18f29 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.375887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 452/894] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:02.377331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645891e-5580-4a7a-8f5c-b49b7c6eca10 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.377621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645891e-5580-4a7a-8f5c-b49b7c6eca10 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.377901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645891e-5580-4a7a-8f5c-b49b7c6eca10 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.379482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 453/895] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:02.384220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645891e-5580-4a7a-8f5c-b49b7c6eca10 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.393344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.394433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 443/896] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:02.395292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.520463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac802a95-a9be-4f34-b599-05cc8ed20ee7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.523366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645891e-5580-4a7a-8f5c-b49b7c6eca10 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.558475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.559531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.560124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.560467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.565979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.566596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.566929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.567282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.567845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.569242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fee59-cc28-45e0-bb6f-2c6b19eea4ed None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.569359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.571035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.575503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 454/897] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:47:02.576969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.577421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.577861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:02.591168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:02.592214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:02.593201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 444/898] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:02.598364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.605662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:02.607034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:02.639059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.688594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.693820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 455/899] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:02.694558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.748024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efbd63-23fb-488d-b652-ee886780aa70 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.795169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.795792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.796073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.796344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.797105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:02.797409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.798964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.835641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 445/900] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:02.840911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:02.849034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730dc14-c78f-4611-ac4e-c3974da483e6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:02.894886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:02.895426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:02.895703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:02.895972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:02.896803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:02.898297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:02.961316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.978273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9841c-e91c-48a1-8bd4-12c9daa324e4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.017915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.018628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.018925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.019260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.030876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 456/901] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:47:02 2022] POST /identity/v3/services => generated 241 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:03.032062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.122239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.134155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.137954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.192070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7ccd-1fbc-4091-8698-d9cd8e8cffcc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.250945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.252599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.252892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.253171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.253771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.255272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.258744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:03.266252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:03.267875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:03.268797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 457/902] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:03.273243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.277666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 446/903] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:02 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:47:03.284353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.410220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466663bf-9d84-40a9-868f-9d3d0e707b5a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.418275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd71044-cd95-4657-813c-ff1dfa934b9d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.448888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.452478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.453367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.453798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.454179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.467276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.469043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.469741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.470703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.471200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.471635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.472557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:03.473125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.474700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.486685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 458/904] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:03.488047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:03.488824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:03.489996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:03.491119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:03.491119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:03.491119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:03.493168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 447/905] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:03.498567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.555347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.634143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81b82-0a91-4fa5-a19b-5c0074f2092e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.646691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96695a77-7413-452e-9cde-181e0204cee9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.677200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.677771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.678054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.678329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.678984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:03.679432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.680867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.695251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.696119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.696572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.697018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.697800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:03.698250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.699826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.700009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 448/906] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:03.700987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.707904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 459/907] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:03.714232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.774485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.829405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.834154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700bfc-f5bb-47ac-a9f6-70511651a3fc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.845950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ab2e1-f258-426d-92af-4a8fcd885614 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:03.878642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.880334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.881109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.881623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.891558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:03.892097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.892908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:03.893190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:03.893473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:03.894189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] RBAC: Adding query filter params (interface=public, service_id=0f82dd2db9614286bae0ef9f8313f98c, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:03.894504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:03.895536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.896163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:03.905924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 460/908] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/endpoints?service_id=0f82dd2db9614286bae0ef9f8313f98c&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:03.910488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:03.911447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:03.912382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:03.914692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 449/909] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:03.921664 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:03.921962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:04.062253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0af9-a7f8-4803-a96f-509e8e2564c8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:04.090200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746b4b-2a32-4c65-b622-e153fd6a0718 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:04.103847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:04.104875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:04.105003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:04.105297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:04.106112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:04.106486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:04.108078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:04.110301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:04.123270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 450/910] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:04.132705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:04.144360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:04.145027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:04.145314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:04.145593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:04.146339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:04.147744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92478a22-d126-4bb4-bbbb-30e14cedc6e3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:04.165342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:04.165662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 461/911] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:03 2022] GET /identity/v3/services => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:47:04.268594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1432d-dfb0-4e44-81ac-4811147da16c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:04.307731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:04.308369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:04.308675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:04.308949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:04.309702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] RBAC: Adding query filter params (role.id=cf098d4b63944277b1c33c1b98b12010, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b0c4bdc0bd494a61b889dc79354b3f2d) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:04.310007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:04.311543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952963fc-9c34-4263-816d-91e3e302b617 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:04.320462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 451/912] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:04 2022] GET /identity/v3/role_assignments?user.id=b0c4bdc0bd494a61b889dc79354b3f2d&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=cf098d4b63944277b1c33c1b98b12010 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:05.022104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed191f-6278-4417-a680-6e3860b4347d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.022638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed191f-6278-4417-a680-6e3860b4347d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.022887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed191f-6278-4417-a680-6e3860b4347d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.024690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 462/913] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:05.030641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2abfe-14f9-4e6c-8bd5-b2c1d0213f5b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.030932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2abfe-14f9-4e6c-8bd5-b2c1d0213f5b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.031181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2abfe-14f9-4e6c-8bd5-b2c1d0213f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.051518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-43e2abfe-14f9-4e6c-8bd5-b2c1d0213f5b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:05.052777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-43e2abfe-14f9-4e6c-8bd5-b2c1d0213f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:05.132603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 452/914] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:05.397024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd94e-b06a-48f9-9d32-dc622f330763 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.397429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd94e-b06a-48f9-9d32-dc622f330763 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.397613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd94e-b06a-48f9-9d32-dc622f330763 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.399224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 463/915] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:05.405123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.405604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.405680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.410451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd94e-b06a-48f9-9d32-dc622f330763 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:05.431854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:05.433579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:05.449233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:05.536353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd94e-b06a-48f9-9d32-dc622f330763 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:05.540654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 453/916] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:05.590096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:05.590769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.591054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.591332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.591942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:05.593398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:05.603632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:05.604751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:05.605618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 464/917] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:05.614085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:05.732306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660257d-192a-4bbc-91fb-4f9b7f1b61e7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:05.770500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:05.771437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.771926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.772381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.773224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:05.773707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:05.775255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:05.781104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 454/918] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:05.792002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:05.833775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:05.841560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:05.847411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:05.921595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e114d4-c45b-4049-a1b9-c727b6338563 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:05.963482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:05.965210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:05.965686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:05.966139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:05.966979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:05.968298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:05.970842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:05.983464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c97b4-1d95-4f52-92da-699a22434700 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:05.983640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 465/919] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Sep 8 13:47:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:05.984727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:06.039979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.041039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.041390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.041737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.042413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.044726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:06.057487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:06.058568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:06.059411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:06.064995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 455/920] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:06.066488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:06.118121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e278a-befe-49e7-bfe7-af3ef53e612e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:06.122464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:06.164133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.164459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:06.165542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.166033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.166539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.167509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.169143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.201587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629746e9-59db-4cad-93c2-4422970078f2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:06.240241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.240762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.241048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.241315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.241958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:06.242264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.243677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.249509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 456/921] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:06.255304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:06.357813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 466/922] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:06.383006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24c3ea-9f84-4681-b736-a75333a70a32 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:06.427980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:06.434328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.435007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.435292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.435778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.436279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:06.436664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.438274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ba7b3-7fe1-46fc-aaea-3da2cccdbb27 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.444812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 457/923] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:06.451297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:06.492653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c121-9501-45a7-885b-577e8970dc9d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.492942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c121-9501-45a7-885b-577e8970dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.493190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c121-9501-45a7-885b-577e8970dc9d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.495679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 458/924] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:06.508432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.508792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.509036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.537039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:06.539636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:06.593719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cf5e0-f2d8-4f2d-8fad-c0c4dc373a4b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:06.626505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 459/925] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:06.658597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.659727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.660259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.660797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.662143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] RBAC: Adding query filter params (interface=public, service_id=245ab34055274b2890ff2bffa799f836, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:06.662951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.665617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a8c69-8f13-4dcb-887c-8830351b2a37 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.675645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 467/926] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:47:06 2022] GET /identity/v3/endpoints?service_id=245ab34055274b2890ff2bffa799f836&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:06.682052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:06.693012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28507a64-1465-4dc9-afa5-ba328c699de1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.693293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28507a64-1465-4dc9-afa5-ba328c699de1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.693667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28507a64-1465-4dc9-afa5-ba328c699de1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.695233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 468/927] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:06.701444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.702023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.702314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.726224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:06.726224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:06.747160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:06.811810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 469/928] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:06.833001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86377779-6bd3-4fce-b980-9560422287a6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:06.874732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:06.885001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:06.885608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:06.885889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:06.886167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:06.886908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:06.892064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:06.896611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 460/929] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:06 2022] GET /identity/v3/services => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:47:06.924498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.132533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32924f3-74af-49dc-8be5-91656a8416ba None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:07.174760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50b229-315b-4578-8087-31f809704a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:07.175804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b229-315b-4578-8087-31f809704a0c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:07.176331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b229-315b-4578-8087-31f809704a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:07.176841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b229-315b-4578-8087-31f809704a0c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:07.177655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50b229-315b-4578-8087-31f809704a0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:07.179248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50b229-315b-4578-8087-31f809704a0c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-be50b229-315b-4578-8087-31f809704a0c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:07.189196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:07.190522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:47:07.191438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:07.194387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 470/930] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Sep 8 13:47:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:07.201430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.288630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50b229-315b-4578-8087-31f809704a0c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.311996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:07.385925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d26ce-31f4-4e36-b64a-f0e48b6b9412 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:07.447901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50b229-315b-4578-8087-31f809704a0c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:07.458423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:07.460232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:07.460968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:07.462213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:07.463507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:07.464230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:07.467772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:07.479171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 461/931] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:07.488589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.507698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:07.509609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:07.510189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:07.510759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:07.531829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:07.542127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:07.543135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:07.543977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:07.552373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 471/932] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:07.554123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.593755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:07.680954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e6ef-69ba-486c-ace8-a0634bf798a7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:07.738671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:07.755956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:07.757822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:07.758671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:07.759495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:07.761010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:07.761734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:07.765162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:07.777048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 462/933] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:07.777982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88e2f-40d8-4b84-9f93-de30cc7981e8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:07.790194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:07.855566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:07.857042 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:07.857626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:07.858123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:07.859437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:07.859994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:07.862721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:07.881376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 472/934] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:07.890709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:08.009444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab71b3-ef6b-405c-b70e-bad96dcf8e44 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:08.051230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:08.086125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:08.087478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:08.102301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:08.102301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:08.102301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:08.102301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:08.102836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408ff-2c0f-4fb7-aa80-5b31a69f4f06 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:08.147199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:08.148732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:08.149278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:08.149806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:08.162823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:08.165364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:08.167283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:08.183595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:08.185556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:08.187826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:08.187826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:08.187826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:08.190577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:08.191515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:08.332546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 463/936] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:08.332837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4dd2-d150-4484-a38c-ff960a7df670 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:08.387064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:08.387699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:08.387984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:08.388261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:08.389008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:08.389317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:08.390830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:08.407180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 474/937] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:08.417359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:08.634228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75464f4c-d394-40a7-9269-df263bc7d601 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:08.706449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:08.707970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:08.708803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:08.709532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:08.724980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:08.728113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:08.751427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:08.753496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:08.755324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 464/938] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:47:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:08.768071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:08.868208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:08.934513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d1b7-3a9f-4337-8665-1bd2a15e839b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:08.981043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:08.981741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:08.982025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:08.982301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:08.983083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:08.983368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:08.984843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91274d-f4f4-48d4-a856-c681408946a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:09.006735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 475/939] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:47:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:09.016592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.043515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc7ac-c8f6-4126-9d1d-f5473f96e8a5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.043803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc7ac-c8f6-4126-9d1d-f5473f96e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.044171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc7ac-c8f6-4126-9d1d-f5473f96e8a5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.045753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 476/940] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:09.051936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.052220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.052580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.072876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:09.074140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:09.090145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:09.155372 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 477/941] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:09.228015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242866-e2c0-42c6-b8fb-a153a85ba893 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:09.291017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:09.292660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.293395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.294237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.313826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:09.317042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:09.347260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:09.348908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:09.350336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:09.350336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:09.350336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.356463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 465/942] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:09.360666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.421664 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:09.455266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.509602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d8938-a133-403b-82a9-df5dfdc3f6f8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:09.560561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:09.560561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.560561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.560561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.561440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:09.561628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:09.562952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:09.576273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 478/943] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:09.585514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.617580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:09.638449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33a164-66ce-473c-9202-986d336018f4 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:09.692009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:09.693039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.693545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.694076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.695058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:09.697098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:09.700954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING keystone.server.flask.common [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 13:47:09.737618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:09.744422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faefc37-2304-4d00-9515-e770b8347157 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:09.791225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.sql.core [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:47:09.791225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:47:09.791225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [parameters: {'id': '6b2e15e44c5e44a2a5361ef833c3a572', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:47:09.791225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81765) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:47:09.792541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:09.793207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:09.793491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:09.795032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:09.802314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:09.803829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:09.817151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:09.823225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:09.825639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 479/944] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b2e15e44c5e44a2a5361ef833c3a572.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b2e15e44c5e44a2a5361ef833c3a572. Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:47:09.826160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 13:47:09.826929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application yield resource Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise self.value Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application session.commit() Sep 08 13:47:09.827889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:47:09.830829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:47:09.833882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application result.read() Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:47:09.835805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [parameters: {'id': '6b2e15e44c5e44a2a5361ef833c3a572', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.838551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:09.840684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b2e15e44c5e44a2a5361ef833c3a572. Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 466/945] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Sep 8 13:47:09 2022] POST /identity/v3/projects => generated 262 bytes in 369 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:09.843155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.844656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:09.984282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbdcd-5f82-40c0-90a0-5f39529e6c2f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:09.988145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77045206-041a-42e7-8698-a48c5e5accda None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:10.023741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:10.024391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.024718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.024994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.029843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:10.030479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.030762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.031043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.031755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:10.032071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:10.032898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:10.033656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:10.034828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-19e733dc-5413-47e8-97ed-47af920491c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:10.047650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:10.050184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:10.052674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:10.054546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 467/946] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:10.062520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 480/947] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:10.062796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8a01-a6c4-4eb6-9286-8ca707f64d56 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.062796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8a01-a6c4-4eb6-9286-8ca707f64d56 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.063103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:10.063256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8a01-a6c4-4eb6-9286-8ca707f64d56 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.063256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 468/948] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:10.066744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a8a01-a6c4-4eb6-9286-8ca707f64d56 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:10.070209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:10.095767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:10.216161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09076d11-a8a3-496b-a6e8-4ab8b0d118e4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:10.219700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a8a01-a6c4-4eb6-9286-8ca707f64d56 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:10.256066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:10.256871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.257501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.257615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.258325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:10.264398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:10.264398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce78a-c209-4bcb-a429-991c50f779aa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:10.270079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:10.270843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.271192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.271536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b0c4bdc0bd494a61b889dc79354b3f2d/roles/cf098d4b63944277b1c33c1b98b12010` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.274638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=b0c4bdc0bd494a61b889dc79354b3f2d, role_id=cf098d4b63944277b1c33c1b98b12010)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:10.276150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:10.280177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 481/949] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:10.281522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.281817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.282092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.321408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:10.321408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:10.422531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 482/950] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:10.470565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 469/951] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:47:10 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/b0c4bdc0bd494a61b889dc79354b3f2d/roles/cf098d4b63944277b1c33c1b98b12010 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:47:10.724016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:10.733164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:10.840263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c375-6b6b-4e05-a517-986b9e76d92f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:10.880540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:10.881649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:10.882154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:10.882649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:10.883592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:10.885528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:10.900752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:10.902984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:10.904780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:10.910459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 483/952] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:10.921008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:11.020550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:11.072779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94dab4-1f62-49db-b1a5-a388ec1d86f1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:11.117892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:11.119145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:11.119654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:11.120147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:11.121099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:11.121641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:11.123312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14120db2-2c90-4efd-bff1-26a4ee1039e3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:11.130824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 470/953] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:11.137207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:11.205704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb8cf2-5d0d-4e7f-9898-bfdff514be9f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:11.206174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb8cf2-5d0d-4e7f-9898-bfdff514be9f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:11.206630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb8cf2-5d0d-4e7f-9898-bfdff514be9f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:11.215865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 471/954] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:11.218277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:11.218788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:11.219266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:11.231344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:11.250394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:11.254697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:11.273717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ac6f-f559-491a-a923-5f595dfb042e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:11.324163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:11.325120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:11.325504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:11.325887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:11.326773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:11.327184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:11.328728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:11.340397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 484/955] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:11.341567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:11.408836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 472/956] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:11.471249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e296-f6ee-4e58-810a-9fee2711172c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:11.509257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:11.510251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:11.510757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:11.511243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:11.512161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:11.513788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:11.519142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:11.650205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 485/957] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:11.863828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:11.943996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:12.009751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9ff91-f8ca-49db-940b-a5b4c13bbec2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:12.066197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:12.067241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:12.067760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:12.068267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:12.069146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:12.070947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:12.082205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:12.083300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:12.084200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:12.087733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 473/958] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:12.098537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:12.320842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0ca2f-1983-49a1-a677-a701022a522e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:12.399445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:12.401153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:12.401986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:12.402479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:12.403403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:12.403915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:12.405756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e421-097d-4204-ba3a-de0ca6451dca None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:12.414419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 486/959] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:12.426148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:12.546919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242b9c-9023-4f67-ad7b-1ae520e62d07 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:12.568383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:12.588919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:12.589446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:12.589720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:12.589993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:12.590638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:12.590940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:12.592414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5276-f458-4b22-8b8c-face0452f7a6 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:12.598516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 474/960] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:13.025235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348f16-add7-42ec-8b3f-764bf00964c2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.025692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348f16-add7-42ec-8b3f-764bf00964c2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.026065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348f16-add7-42ec-8b3f-764bf00964c2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.027774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 487/961] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:13.034455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632fca-a2d2-41b7-aa84-249950f95453 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.035002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632fca-a2d2-41b7-aa84-249950f95453 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.035216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632fca-a2d2-41b7-aa84-249950f95453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.056491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5b632fca-a2d2-41b7-aa84-249950f95453 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:13.057752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5b632fca-a2d2-41b7-aa84-249950f95453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:13.141504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 475/962] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:13.394731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822ade-d7dd-4184-b1f1-4e4f76f00451 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.395782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822ade-d7dd-4184-b1f1-4e4f76f00451 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.396279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822ade-d7dd-4184-b1f1-4e4f76f00451 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.398181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 488/963] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:13.404059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.404683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.405159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.424838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:13.426388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:13.436075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d822ade-d7dd-4184-b1f1-4e4f76f00451 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:13.504723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:13.532547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 476/964] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:13.558622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d822ade-d7dd-4184-b1f1-4e4f76f00451 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:13.598456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:13.599078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.599358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.599634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.600306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:13.601823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:13.604417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING keystone.server.flask.common [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 13:47:13.647982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:47:13.647982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:47:13.647982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [parameters: {'user_id': '47fd2677c8404410bad587668c6d2d29', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:47:13.647982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Sep 08 13:47:13.655813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:47:13.656802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:47:13.658894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:47:13.662587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:47:13.665411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:47:13.667667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'user_id': '47fd2677c8404410bad587668c6d2d29', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:13.671740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 13:47:13.673779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:13.675847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 489/965] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Sep 8 13:47:13 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:13.677061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:13.726344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:13.824214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de33bc8-fdd7-4cf5-b618-4d10dfcc4f2e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:13.827836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:13.903165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:13.903726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:13.904005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:13.904278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:13.914020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:13.915539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:13.928929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:13.930197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:13.931803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 477/966] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:47:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:13.936481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:13.999264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2d63e-6e4a-4c28-99bf-d813af0f7ad0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.020272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:14.042670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.043349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.043631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.043909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.059918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:14.066178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:14.068308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:14.069228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 490/967] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:14.076440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:14.086032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:14.089448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9bc0-2a0a-449b-b3d4-fac01e80f1c1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.133031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.133293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.133685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.134027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.134856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:14.135248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:14.136947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:14.186903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 478/968] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Sep 8 13:47:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:14.207834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63838f-6922-4cae-8a90-c3467a293926 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.254447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.255745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.256231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.256743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.257658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:14.258228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:14.260181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:14.279566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 491/969] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:14.282047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:14.418448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc832c-3a30-48a7-b1a1-f789923f6e64 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.462454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.463174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.463460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.463733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.477132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:14.478678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:14.495185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:14.496193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:14.497430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:14.497430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:14.497430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:14.497430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 479/970] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:14.504454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:14.552743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:14.619050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5f4ff-f39d-476e-8397-b1e6d0a6951d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.666143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.667205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.667719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.668217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.669442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:14.669991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:14.672608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:14.696550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 492/971] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:14.702196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:14.716425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:14.822425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bce0f-6206-4a26-a793-fad9b40d32cb None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:14.862805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:14.863636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:14.864109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:14.864547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:14.873357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:14.874992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:14.887561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:14.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:47:14.891559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:14.894078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 480/972] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:47:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:14.897849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.025432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:15.033749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33632851-8613-4bf8-bc62-02897ab4ce3e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:15.094374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:15.096301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.096911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.097477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.098913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:15.099540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:15.102325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c23ffe-c6bf-4517-a9f5-048f604ed259 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:15.139304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 493/973] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Sep 8 13:47:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:15.140610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.214285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:15.248634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbe7be-e002-44b6-807f-b583385fc256 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:15.289584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:15.290397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.290780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.291149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.366712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:15.368413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:15.439636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:15.474662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 481/974] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:47:15.479964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.480393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a9a0-1c61-4063-bfc8-de5b4a216156 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.480939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a9a0-1c61-4063-bfc8-de5b4a216156 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.481428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76a9a0-1c61-4063-bfc8-de5b4a216156 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.484089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 494/975] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:15.493989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.494486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.494976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.527480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:15.530129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:15.596654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54554a-74f7-46c9-9982-d3a20e2bfada None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:15.638737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:15.639816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.640310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.640831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.655794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:15.657299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:15.658114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 495/976] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:15.690467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:15.691545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:15.692497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:15.692497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:15.692497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:15.693245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 482/977] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:15.702637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.820692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:15.836723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897f707-ca58-4313-a3db-54a85e8952ac None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:15.896329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:15.897441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:15.897938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:15.898419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:15.899631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:15.900174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:15.902829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:15.931722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 496/978] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:15.933402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.948711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:15.971620 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.083309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89d458-f6e7-49fb-a254-fc42ebf0e820 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.103419 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7945b0-99d5-4cfa-b67e-864a18b9874b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.123641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.124369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.124824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.125236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.133226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.134704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-459ac93d-496e-4edd-adfc-f9989b943ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:16.147834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:16.150684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:16.151964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 483/979] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:16.155269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c93ee-bb93-4284-af12-18338a6b73d6 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.155732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c93ee-bb93-4284-af12-18338a6b73d6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.156180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c93ee-bb93-4284-af12-18338a6b73d6 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.158313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 484/980] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:16.159609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c93ee-bb93-4284-af12-18338a6b73d6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.164383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.165542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.165933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.166209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.166943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.169394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9ac198b3-5e96-49c3-a906-7797295461d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:16.185197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:16.187067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:16.188040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:16.192713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 497/981] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:16.194672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465553-801d-4ac7-8d88-225275330342 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.194962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465553-801d-4ac7-8d88-225275330342 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.195246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465553-801d-4ac7-8d88-225275330342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.215621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a4465553-801d-4ac7-8d88-225275330342 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:16.216899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a4465553-801d-4ac7-8d88-225275330342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:16.222018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.283098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.304895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 498/982] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:16.305765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465553-801d-4ac7-8d88-225275330342 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.312668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c93ee-bb93-4284-af12-18338a6b73d6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.354529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.355043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.355324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.355601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.356315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:16.356652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.358107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.376795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 485/983] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:16.379477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.449625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465553-801d-4ac7-8d88-225275330342 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.509119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.510086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.510548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.511086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.512175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:16.512631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.514944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.523949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 499/984] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:16.530262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.536627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.545881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc6f3-70e9-40af-8063-1b9797e646dc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.604101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.605185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.605572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.606038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.607043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] RBAC: Adding query filter params (role.id=cf098d4b63944277b1c33c1b98b12010, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=b0c4bdc0bd494a61b889dc79354b3f2d) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:16.607551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.610142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.624559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 486/985] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:16 2022] GET /identity/v3/role_assignments?user.id=b0c4bdc0bd494a61b889dc79354b3f2d&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=cf098d4b63944277b1c33c1b98b12010 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:16.722453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595c94d-878d-4cd1-b2af-d2f6d7eabb31 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:16.793258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:16.794354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:16.794845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:16.795350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:16.796615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:16.797160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:16.801245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:16.816812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 500/986] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:16.818333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.820764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:16.831103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.918958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:16.984243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80867f-781e-4c62-9a21-bfab0bf45034 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:17.008778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b4c1-f3c3-4cff-9309-ead174036743 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:17.059985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:17.061039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:17.061524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:17.061984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:17.063255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:17.065929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e73d-da58-4e60-8acf-1f60c56253b0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:17.086877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:17.090003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:17.090003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:17.090003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:17.090375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] RBAC: Adding query filter params (interface=admin, service_id=245ab34055274b2890ff2bffa799f836, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:17.090949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:17.093646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:17.103293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 487/987] 10.222.0.33 () {56 vars in 1249 bytes} [Thu Sep 8 13:47:16 2022] GET /identity/v3/endpoints?service_id=245ab34055274b2890ff2bffa799f836&interface=admin®ion_id=RegionOne => generated 193 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:17.109681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:17.152109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 501/988] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:47:16 2022] POST /identity/v3/services => generated 242 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:47:17.227847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:17.270317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1263b6-1f42-456e-8493-232f63f19dcf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:17.325736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:17.326624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:17.327043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:17.327465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:17.328240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:17.330005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bdea9-f0bd-453f-9d14-364d28013b34 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:17.338173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 488/989] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:17 2022] GET /identity/v3/services => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:47:18.970745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2d18-e68f-461a-9418-2367d27fd071 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:18.971553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2d18-e68f-461a-9418-2367d27fd071 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:18.971553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2d18-e68f-461a-9418-2367d27fd071 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:18.972963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 502/990] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:18.982309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bea4-8efa-4685-bb56-7847c9e5a0ff None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:18.982851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bea4-8efa-4685-bb56-7847c9e5a0ff None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:18.983241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bea4-8efa-4685-bb56-7847c9e5a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.014600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c0e6bea4-8efa-4685-bb56-7847c9e5a0ff None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:19.016889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c0e6bea4-8efa-4685-bb56-7847c9e5a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:19.105098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 489/991] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:19.388777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2d18-e68f-461a-9418-2367d27fd071 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:19.491045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798660-27e2-487d-aeb7-a489d0e25753 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.491553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798660-27e2-487d-aeb7-a489d0e25753 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.492043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab798660-27e2-487d-aeb7-a489d0e25753 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.494617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 490/992] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:19.500439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5698-d4e1-430f-8fbb-d75f07b270ea None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.500750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5698-d4e1-430f-8fbb-d75f07b270ea None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.501654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5698-d4e1-430f-8fbb-d75f07b270ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.523211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9bde5698-d4e1-430f-8fbb-d75f07b270ea None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:19.524443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9bde5698-d4e1-430f-8fbb-d75f07b270ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:19.526040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2d18-e68f-461a-9418-2367d27fd071 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:19.575528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:19.588886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:19.599762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.599762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.599762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.599762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:19.599762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:19.607645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:19.610530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:19.612995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 503/993] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Sep 8 13:47:19 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:19.620085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:19.630605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:19.657098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 491/994] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:19.832260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edcae0-dc77-495b-bfad-82c14a8b6abd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:19.856234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f76-3301-4a4d-ad45-a13561c503b8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.856700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f76-3301-4a4d-ad45-a13561c503b8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.856881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f76-3301-4a4d-ad45-a13561c503b8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.858518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 492/995] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:19.864784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.865055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.865346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.885619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:19.886836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:19.907510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:19.908151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:19.908430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:19.909042 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:19.910239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] RBAC: Adding query filter params (name=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:19.910791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:19.913701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:19.929026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 504/996] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:19.929983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:19.998643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 493/997] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:19.999764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.017607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.108304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba906fc3-841e-4ddc-9b84-1d46f8824dda None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.134953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07520235-3023-4b3e-89f2-d2eeefaaeb92 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.155178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.155839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.156121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.156699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.157422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.158989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:20.169753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:20.173471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:20.174365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 505/998] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:20.178230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.179924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.201864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.202763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.203194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.203677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.204923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] RBAC: Adding query filter params (type=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:20.205487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.208141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.223036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 494/999] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:20.304367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.339045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d4b1-2a61-45c3-bf8f-4b74255c41c5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.369937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.390576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.391216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.391738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.392043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.393145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:20.393454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.395381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.401072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 506/1000] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:20.408170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.465763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84ee53-b11e-4c54-922b-de6eb03b5e25 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.508374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.509081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.509367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.509654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.510778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.511770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:20.523653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:20.525498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:20.526997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 495/1001] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:20.532048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.600947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e99353-b1cc-48d5-b5b8-0cadab832801 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.623946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.658352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.659364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.659858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.660333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.661525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:20.662070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.664980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.675440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 507/1002] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:20.684460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.714518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703247-dcf2-4737-ac16-6d5fd8d79b57 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.771235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.776001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.777078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.777572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.778050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.779202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:20.779773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.782833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.792603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 496/1003] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:20.798916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.835809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf2eff-af3d-4c30-ac75-6374b9269124 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.879619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:20.880257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:20.880547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:20.880825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:20.881551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] RBAC: Adding query filter params (interface=public, service_id=86acd00938094bdb8805189fced32b24, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:20.881864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:20.883255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:20.889881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 508/1004] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/endpoints?service_id=86acd00938094bdb8805189fced32b24&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:20.898319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:20.975708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59030e2-3474-4435-9140-fed8ed03aedc None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:20.993493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:21.024606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:21.025637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:21.025963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:21.026387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:21.027231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:21.027696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:21.029432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:21.037579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 497/1005] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:21.046937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:21.085717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72482-ad9e-40b3-ae2f-33f1dd00173e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:21.112575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:21.164053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:21.165100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:21.165587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:21.166082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:21.167342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:21.170069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f1cc3-ede2-4857-993f-823adba0a987 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:21.184825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 509/1006] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:20 2022] GET /identity/v3/services => generated 1727 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:47:21.202290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042648e-78dd-41a3-80fd-f970bcee31a3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:21.254950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:21.255955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:21.256538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:21.257039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:21.258539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:21.261468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dcdb9-b1b2-486c-9b9c-9f2c25db2aa3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:21.418385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 498/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:47:22.794154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aee30e-2658-4c26-8b7d-bea59c4ba7b1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:22.794987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aee30e-2658-4c26-8b7d-bea59c4ba7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:22.795126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aee30e-2658-4c26-8b7d-bea59c4ba7b1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:22.796938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 510/1008] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:22.804435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2ae4-00ad-49f7-9618-7e5002111f73 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:22.804998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2ae4-00ad-49f7-9618-7e5002111f73 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:22.805492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2ae4-00ad-49f7-9618-7e5002111f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:22.831070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a74e2ae4-00ad-49f7-9618-7e5002111f73 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:22.832712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a74e2ae4-00ad-49f7-9618-7e5002111f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:22.870032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:22.952584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 499/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:23.325817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aee30e-2658-4c26-8b7d-bea59c4ba7b1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:23.463258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aee30e-2658-4c26-8b7d-bea59c4ba7b1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:23.507059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:23.507682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:23.507960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:23.508238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:23.508948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:23.510332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda379e2-1d77-449a-ba3d-11920f99adcd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:23.650023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 511/1010] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:47:23 2022] POST /identity/v3/services => generated 242 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:47:24.146821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f30-b79b-4032-96e1-67fc4560d8dc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:24.147375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f30-b79b-4032-96e1-67fc4560d8dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:24.147375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16192f30-b79b-4032-96e1-67fc4560d8dc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:24.148777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 500/1011] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:24.154827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:24.155354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:24.155434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:24.176996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:24.178228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:24.213223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:24.268561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 512/1012] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:24.552780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16192f30-b79b-4032-96e1-67fc4560d8dc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:24.683866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16192f30-b79b-4032-96e1-67fc4560d8dc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:24.728705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:24.729362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:24.729637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:24.729914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:24.731340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:24.732906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cad1d-624c-4671-bdd7-62531b482b74 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:24.734842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 501/1013] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:24.742239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:24.871573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62915b-3ae4-4b8b-b352-e6f68658d69e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:24.914405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:24.915034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:24.915312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:24.915586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:24.916280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:24.917811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:25.015568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa81-ac3f-4c68-b59e-4b346920e70e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:25.016118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa81-ac3f-4c68-b59e-4b346920e70e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:25.017251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2daa81-ac3f-4c68-b59e-4b346920e70e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:25.019588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 502/1014] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:25.025941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:25.026382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:25.026798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:25.048208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:25.050302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:25.073436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 513/1015] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:47:24 2022] POST /identity/v3/projects => generated 311 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:47:25.094262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:25.191297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 503/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:25.694299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:25.726291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:25.897747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45038f33-e50b-4180-aacf-e668b04d6a91 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:25.982607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:25.983721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:25.984219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:25.984748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:25.986035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:25.988486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7fc7a0a3-ad2e-4bab-9d2b-b20704e5158d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:26.006965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:26.009806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.012925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 514/1017] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:26.027954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:26.089704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fbde-de7c-4f9d-a641-a2461bd0a43a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.089989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fbde-de7c-4f9d-a641-a2461bd0a43a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.090266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00fbde-de7c-4f9d-a641-a2461bd0a43a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.091960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 515/1018] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:26.098635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.098898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.099259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.120562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:26.121832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:26.207870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ace96-2c3a-4fb8-915a-39aa6436cdfd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:26.225265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 516/1019] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:26 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:26.276378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:26.277529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.278018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.278487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.279626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:26.280171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:26.283168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:26.293588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 504/1020] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:26.300046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:26.312408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:26.426368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a76cbd-be9e-4095-8867-9443f5c1be72 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:26.469395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:26.470285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.470597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.470879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.471513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:26.471816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:26.473240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:26.479299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 517/1021] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Sep 8 13:47:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:26.486765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:26.520776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:26.651830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6066c7-9368-4485-921b-2fa3a99ffb3b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:26.689971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:26.720595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:26.721967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.722495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.723007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.724323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:26.727046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:26.788634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:26.845613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323b5f-4031-4d70-b399-b61e5a42aa4e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:26.880972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 505/1022] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:26.902277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:26.903151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:26.903574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:26.904011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:26.904854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:26.906565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:26.935181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:26.937165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:26.938950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 518/1023] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Sep 8 13:47:26 2022] GET /identity/v3/services/image => generated 86 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:26.942909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:27.124246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:27.158679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c796-e1e8-47fa-85d9-35040ce88402 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:27.233965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:27.235250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:27.237936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:27.237936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:27.238542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] RBAC: Adding query filter params (name=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:27.239767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:27.243912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:27.254379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 506/1024] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:27.264027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:27.467617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd235e-2cfb-4bf2-a403-54414e9d87f9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:27.534966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:27.545501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:27.547036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:27.547793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:27.554747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:27.554747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] RBAC: Adding query filter params (type=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:27.554747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:27.554747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b9fc-92d3-47f1-b00e-139ba228ac6e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:27.571815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 519/1025] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:27.574476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:27.592441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a6e4-90da-4216-b136-3f5b01b95a20 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:27.592753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a6e4-90da-4216-b136-3f5b01b95a20 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:27.593096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a6e4-90da-4216-b136-3f5b01b95a20 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:27.595262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 520/1026] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:27.601113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:27.601401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:27.601752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:27.622023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:27.623251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:27.759401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 521/1027] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:27.763923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e1eb0-c971-409c-b6e7-7d5a427eb722 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:27.828160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:27.829840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:27.830365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:27.830868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:27.832194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] RBAC: Adding query filter params (interface=public, service_id=e7affa989ad244a0a3552c036baf8823, region_id=RegionOne) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:27.832786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:27.835369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:27.845685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 507/1028] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:47:27 2022] GET /identity/v3/endpoints?service_id=e7affa989ad244a0a3552c036baf8823&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:27.855410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:28.019296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c47e-253c-46b7-bb6d-2ad61955c778 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:28.061631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:28.082226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:28.083197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:28.083674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:28.084150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:28.085517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:28.088489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:28.109124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 522/1029] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:47:27 2022] GET /identity/v3/services => generated 1957 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:47:28.174418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:28.189700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:28.316386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21172e-772f-44c7-9132-128a747950b8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:28.370380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:28.371325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:28.371733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:28.372138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:28.374097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:28.377038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677ecf7-528f-4122-af38-332496d04b7f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:28.379995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 508/1030] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:28.386571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:28.517128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a846b9c-3a1c-4b0e-944c-c2d0fa499450 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:28.562696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:28.563808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:28.564304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:28.565063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:28.566296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:28.569252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9905000-a1a3-4da8-9eff-996555e0347f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:28.706289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 523/1031] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:47:28 2022] POST /identity/v3/users => generated 285 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:29.599475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c77c0-4805-4b47-bf24-0c86844c96b8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:29.600078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c77c0-4805-4b47-bf24-0c86844c96b8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:29.600078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c77c0-4805-4b47-bf24-0c86844c96b8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:29.601587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 509/1032] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:29.607021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:29.607703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:29.607703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:29.633572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:29.634494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:29.692085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:29.720375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 524/1033] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:30.003827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c77c0-4805-4b47-bf24-0c86844c96b8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:30.096289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:30.123891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c77c0-4805-4b47-bf24-0c86844c96b8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:30.165978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:30.166796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:30.167089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:30.167417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:30.187872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:30.196538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:30.198441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:30.200114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 510/1034] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:30.212554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:30.430969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108946-45e3-41fa-8356-a2fde0ef38bd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:30.511325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:30.512710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:30.513454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:30.514123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:30.515597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:30.516353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:30.519511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410ac3c-77af-485d-ab59-c3e1a5311145 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:30.540548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 525/1035] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:30.545906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:30.712850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459c2e-1aaa-4604-b55e-f9cc0c65bb03 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:30.782630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:30.783803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:30.784363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:30.784874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:30.790405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:30.807808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:30.810638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:30.842706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:30.845516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:30.847360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:30.847360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:30.847360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:30.847747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb155f3-463a-479e-90a0-6296b5fd0ee5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:30.847747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb155f3-463a-479e-90a0-6296b5fd0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:30.847747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb155f3-463a-479e-90a0-6296b5fd0ee5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:30.849929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 511/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:30.850146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 526/1037] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:30.855448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:30.861242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:30.861814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:30.862286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:30.884195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:30.885475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:30.929701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:30.991454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 527/1038] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:31.056364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d69e1-5042-4c10-b12c-b657e48a0c1c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.121597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.122647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.123211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.123708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.124918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:31.125465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:31.130738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b348c-2939-4c27-8387-4de7feecbba0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:31.159401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 512/1039] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:31.161791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:31.274762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de19c8-3bde-416d-ba53-367da98b29b4 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.275072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de19c8-3bde-416d-ba53-367da98b29b4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.275334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de19c8-3bde-416d-ba53-367da98b29b4 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.276726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 513/1040] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:31.282202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.284446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.284446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.308271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:31.309769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:31.357803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649ea21-3603-4067-9cde-10df7e67d68e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.390246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:31.418064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.419045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.419490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.419922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.433313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:31.435708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:31.441636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 514/1041] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:31.459213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:31.460288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:31.467025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 528/1042] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:31.469012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:31.477418 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:31.533026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:31.631685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89460-194b-43f3-9467-28cfbf457bf6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.676003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.676672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.676955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.677126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a511ef-27af-4729-9825-0616e95ac9ee None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.677276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.677970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:31.678278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:31.679811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:31.710386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 515/1043] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:31.713883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:31.743437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.744325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.744768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.745199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.746020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:31.747592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:31.759394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:31.761651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:31.762592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 529/1044] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/services/image => generated 86 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:31.771400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:31.782663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:31.873234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40837-3f74-405b-b9ec-bd89622df87c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.911632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:31.923559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0eb0b3-3bb6-4cc2-b3cf-3eba4a4a492c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:31.924162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.924917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.925362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.925806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.966571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:31.967207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:31.967497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:31.967764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:31.968563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] RBAC: Adding query filter params (name=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:31.968726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:31.970910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:31.976307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 530/1045] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:31.977186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.028263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.031303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.079000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:32.140790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe821f1-62cf-42b5-9907-5e08c2abf883 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.169000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 516/1046] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:47:32.169000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.201763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.202735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.203121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.203573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.218129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:32.224328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:32.226208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 531/1047] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:32.228376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.256995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:32.312900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b569-afb5-41c9-9007-68ad06549541 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.358023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.358802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.359175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.359544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.360301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:32.361785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.363516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.365816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188653-4672-448e-902c-1f93b668ea60 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.366413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:32.376579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 517/1048] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:32.376579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.417607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.418336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.418958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.419304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.432215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.434165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:32.451615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:32.453819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:32.457131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:32.457131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:32.457131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:32.457131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 532/1049] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:32.457131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.512223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e9b16-c8e1-48c4-9c03-2359d09fb4f2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.536380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:32.562536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.564166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.564738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.565158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.565998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:32.566434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.567985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.582133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 518/1050] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:32.583535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.590471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab1fb9-1681-4811-b72d-49fec68b0a5f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.632356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.633028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.633307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.633583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.634268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.635681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.691975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:32.733840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba2b5c-3cbc-4edd-bd17-cc0bbdb93602 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.771254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:32.771872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:32.772157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:32.772444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:32.773110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:32.773433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:32.774828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:32.788614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 519/1051] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:32.789663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.838288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 533/1052] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:47:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:32.839153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:32.946926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df048bb-81ed-4e56-9480-2e9799f6cb56 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:32.982987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.011297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.011951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.012233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.012538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] PATH_INFO: `/v3/users/35a727e3a77942139945c7259a896559` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.014753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df04f2-e391-4818-bfb6-11a361506f33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.031252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=35a727e3a77942139945c7259a896559)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.033105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.040832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 520/1053] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/users/35a727e3a77942139945c7259a896559 => generated 285 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:33.041556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:33.043002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.063624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.064891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.065310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.065661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.075175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.077458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:33.093356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:33.094507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:33.095619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:33.100174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 534/1054] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:33.101435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:33.217259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd533dd-56af-489f-b66b-3ea65b8fc3a7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.269935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.270558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.271007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.271191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.287054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e8f-9924-41b0-ae4e-745f0f263a43 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.326851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.364350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.365008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.365288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.365590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.366351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:33.366661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.368110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.374849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.377775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.389959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 535/1055] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:33.398033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:33.468219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.568074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 521/1056] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:47:33.573040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9522343-0e95-4b73-997e-bedaf4ee80e0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.575089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:33.617303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.617928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.618228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.618517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.619428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] RBAC: Adding query filter params (role.id=cf098d4b63944277b1c33c1b98b12010, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:33.620617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.621269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.629630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 536/1057] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:33 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=cf098d4b63944277b1c33c1b98b12010 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:33.676964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.707336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14237e0-ce1c-446d-b097-c8fca86323d9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.751371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.752619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.752940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.753513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.755245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.757038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3370e-1291-4c47-af56-97baa24f31ab None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:33.759511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 522/1058] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:33 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:33.766438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:33.911258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f88f67-d34f-44ca-9758-90ffc8c45675 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:33.919347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:33.983801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:33.984881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:33.985565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:33.986065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:33.987394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8, user.id=35a727e3a77942139945c7259a896559) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:33.987880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:33.990499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c8f04-5415-4bbf-941e-2c3230fd7d5f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:34.008716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 537/1059] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:33 2022] GET /identity/v3/role_assignments?user.id=35a727e3a77942139945c7259a896559&scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:35.331898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e57a9-a014-4b89-abaf-9e1b36d61de7 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:35.332445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e57a9-a014-4b89-abaf-9e1b36d61de7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:35.332445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e57a9-a014-4b89-abaf-9e1b36d61de7 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:35.334125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 523/1060] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:35.339626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a03e-08d0-41f1-97bd-70e2982e9049 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:35.340091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a03e-08d0-41f1-97bd-70e2982e9049 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:35.340192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a03e-08d0-41f1-97bd-70e2982e9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:35.365086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d241a03e-08d0-41f1-97bd-70e2982e9049 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:35.367186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d241a03e-08d0-41f1-97bd-70e2982e9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:35.488557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 538/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:35.795175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e57a9-a014-4b89-abaf-9e1b36d61de7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:35.951272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6d1b-c861-499d-a17a-502715d733bc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:35.951538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6d1b-c861-499d-a17a-502715d733bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:35.951822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d6d1b-c861-499d-a17a-502715d733bc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:35.953533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 539/1062] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:35.959896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:35.960234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:35.960462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:35.992216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:35.993792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:36.012553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e57a9-a014-4b89-abaf-9e1b36d61de7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:36.069060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:36.069787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.070226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.070697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.091228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:36.106598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 540/1063] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:36.200877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:36.203402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:36.396542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:36.414587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 524/1064] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:47:36.426345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:36.441908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:36.506547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:36.554155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf47d6-e183-4ec1-ab8f-91cfc94a6080 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:36.587640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a22a8-fa40-47d5-9f85-4ce855291646 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:36.601810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:36.602498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.602782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.603060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.617296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-57199c76-9411-482b-9bbd-f25175c77c39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:36.622545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:36.624386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 541/1065] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:36.625535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb6d-8483-4892-9de6-2875854199da None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.627074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb6d-8483-4892-9de6-2875854199da None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.627074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543bb6d-8483-4892-9de6-2875854199da None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.629466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 542/1066] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:36.634760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543bb6d-8483-4892-9de6-2875854199da None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:36.645136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:36.647981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.647981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.647981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.659559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:36.661120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-82e84f3d-a5da-4d54-bd43-73aa6b85c131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:36.679359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:36.681300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:36.682293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:36.682293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:36.682293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:36.682293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 525/1067] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:36.682541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.682621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.682897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.708490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:36.709854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:36.757444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:36.774705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543bb6d-8483-4892-9de6-2875854199da None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:36.812144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 526/1068] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:36.812863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:36.825646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:36.828298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:36.828784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:36.829814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:36.831233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:36.832433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:36.835552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:36.856292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 543/1069] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:36.858152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:36.866126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.011782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517023-f3f9-4753-943b-dd67e732e2b1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.029669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad7091-1693-44c4-9326-572915e2ee65 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.057119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.057698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.057977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.058250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.060727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:37.060727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.060943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.079725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 527/1070] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:37.100432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.102097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.102954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.103718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.127983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.131150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.142838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:37.167803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:37.169808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:37.171683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:37.171683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:37.171683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:37.171683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 544/1071] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:37.178671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.180698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.311568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.316442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0b95f-da78-444c-a34e-852ae15d6022 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.336097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051e2f6-26cb-490a-b259-4475a8c2e9e1 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.386438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.387064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.387397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.387724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.388427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:37.388854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.390772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.413219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 545/1072] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:37.415709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.417839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.417839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.417839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.421150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.436712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:37.443352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:37.445489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:37.447327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 528/1073] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:37.451787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.514829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.565326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734370-0c93-4650-a8bf-e67ba22489f5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.605182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.605927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.606210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.606481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.611659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045eb82-4baf-47bb-8916-b269330328f6 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.616922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.618440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:37.639679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:37.640829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:37.642513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 546/1074] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:37.648554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.661245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.670510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.689091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 529/1075] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:37.690952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.703715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.782537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b64d5-503f-4c9e-8e7d-f23f8b7cb7e9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.822362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:37.836803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.837527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.837872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.838231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.839034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8911-10f2-4beb-9f88-df311c0934c3 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:37.839238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:37.839451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.841179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.863075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 547/1076] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:37.869357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:37.896637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:37.897689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:37.898146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:37.898587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] PATH_INFO: `/v3/users/35a727e3a77942139945c7259a896559` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:37.900060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] RBAC: Authorizing `identity:get_user(user_id=35a727e3a77942139945c7259a896559)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:37.901583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:37.903457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 530/1077] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/users/35a727e3a77942139945c7259a896559 => generated 285 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:37.913890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.002928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f2c1-3a34-4d3c-8739-18aac5bba842 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.020833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:38.058433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d275-02c9-4bee-abc3-a49f8ebc7a76 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.059733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.060743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.061158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.061588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.079425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.081846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:38.106724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:38.108707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:38.110947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:38.110947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:38.110947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:38.110947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 548/1078] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:38.116167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.122060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.123014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.123493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.123932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.125721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.128984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.131813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 531/1079] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:37 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:38.138847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.161076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:38.259168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d678554-ea45-4be8-b8eb-742a0fb915d4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.277330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec2a91-081a-427d-85a9-99bb5d21b9d8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.312228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.312975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.313430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.313885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.314683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:38.315147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.316685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.324970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.326038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.326485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.326940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8/users/35a727e3a77942139945c7259a896559/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.330427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8, user_id=35a727e3a77942139945c7259a896559, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.333078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.338414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 549/1080] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:38.344269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.448617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:38.459155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839350c2-6ce5-423e-b6c2-bbff1762a89b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.491296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 532/1081] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:47:38 2022] PUT /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8/users/35a727e3a77942139945c7259a896559/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:47:38.502477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.503824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.504258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.504741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.516245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.518842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:38.534588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:38.536743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:38.538887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 550/1082] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:38.547676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.554564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:38.732193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0266f-5625-4d70-bbb3-a1ace53efa51 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:38.775718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:38.776432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:38.776890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:38.777170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:38.777872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:38.778176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:38.779601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e5835-0341-4e45-8583-46eceeb18546 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:38.794454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 533/1083] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:38.801629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:38.965258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70504b-519e-47e5-90f5-75ab6947a140 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:39.005640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:39.006297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:39.006648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:39.006995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/cf098d4b63944277b1c33c1b98b12010` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:39.009391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=171bca600dcb4dcba12c02fb3dc67197, role_id=cf098d4b63944277b1c33c1b98b12010)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:39.010907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c712d80-4729-4a95-a60c-46488705f4c6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:39.109150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 551/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:47:38 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/171bca600dcb4dcba12c02fb3dc67197/roles/cf098d4b63944277b1c33c1b98b12010 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:47:40.816439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e870-3328-4d33-89ea-4608640aeb0b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:40.817313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e870-3328-4d33-89ea-4608640aeb0b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:40.817495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9e870-3328-4d33-89ea-4608640aeb0b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:40.819184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 534/1085] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:40.828069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:40.828673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:40.829079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:40.860123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:40.862751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:40.877858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:40.977026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 552/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:41.493131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9e870-3328-4d33-89ea-4608640aeb0b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:41.569912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:41.613740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9e870-3328-4d33-89ea-4608640aeb0b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:41.656000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:41.656695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:41.656982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:41.658017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:41.677543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-016c1dc5-cd0a-4b62-878b-51ae84c093ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:41.682556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:41.684298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:41.686180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 535/1087] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:47:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:41.692395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:41.822744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f858f-2a7e-4328-93b1-45c1fab6d03d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:41.823539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f858f-2a7e-4328-93b1-45c1fab6d03d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:41.823688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f858f-2a7e-4328-93b1-45c1fab6d03d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:41.828563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 536/1088] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:41.828811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55015ec4-b3b6-4650-8eb4-c6a33bf6f186 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:41.836045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:41.836326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:41.836645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:41.859366 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:41.861412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:41.871809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:41.872430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:41.872749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:41.873020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:41.873702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:41.874008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:41.875397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:41.885886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 553/1089] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:47:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:41.892185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:41.896231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:41.952505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 537/1090] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:47:42.062444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bebab-45d5-45b8-ad3e-58a70fde53fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.123789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.124861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.125378 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.125885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] PATH_INFO: `/v3/users/35a727e3a77942139945c7259a896559` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.128024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] RBAC: Authorizing `identity:get_user(user_id=35a727e3a77942139945c7259a896559)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:42.130708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:42.138650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 554/1091] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:41 2022] GET /identity/v3/users/35a727e3a77942139945c7259a896559 => generated 285 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:42.140085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.217689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.230465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.295129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17864c-4efc-4c36-8e3d-3af839264afa None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.313426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.350978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.351601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.351888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.352164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.357464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510ee1-fe55-4d4d-86c3-b020aa2dbd38 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.398856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.399464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.399862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.400139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.412946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:47:42.419505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:42.421496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:42.423354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 555/1092] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:42.430650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.452442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:42.454271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:42.533983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.573142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e59cd-e3d6-44f5-b0a9-644eb5f0dc4c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.596484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 538/1093] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:47:42.603874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.613690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.619682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.620450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.621150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.627363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.627363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:42.627363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:42.627363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:42.644984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 556/1094] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:42.646563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.754157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d27e7-c5d7-4688-ae5b-214f1a171d29 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.801610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.802700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.803203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.803705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.805551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f1cec-ec49-4c52-8194-cc3f95a0970b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:42.805803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:42.808607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:42.811990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 539/1095] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:42.819473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.848126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:42.848808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:42.849130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:42.849416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:42.861089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:42.862642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:42.864527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:42.879200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:42.881174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:42.883169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:42.883169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:42.883169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:42.883169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 557/1096] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:42.887733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:42.951841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:42.986278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40169fd-1810-4a38-9a6b-9741fabb9886 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:43.031930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:43.032932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:43.033996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:43.033996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:43.035202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8, user.id=35a727e3a77942139945c7259a896559) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:43.035606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:43.037480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:43.045662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 540/1097] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/role_assignments?user.id=35a727e3a77942139945c7259a896559&scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:43.047077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4eed7-e48a-48c6-bfa2-1569ab6e9974 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:43.111125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:43.111942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:43.113002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:43.113002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:43.114073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:43.114485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:43.116140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:43.134779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 558/1098] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:43.143137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:43.273532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:43.293997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce4ef0-3929-42ab-aff8-1da2b7340268 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:43.339419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:43.340259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:43.340664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:43.341003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:43.351546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:43.353077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:47:43.366294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:43.368255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:47:43.370346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 541/1099] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Sep 8 13:47:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:43.375477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:43.492834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29620dcd-df7c-4337-9299-45d5dbe1ab93 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:43.501754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:43.542778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:43.543435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:43.543717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:43.543995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:43.544844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:43.545103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:43.546586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:43.573687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 559/1100] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Sep 8 13:47:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:43.581917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:43.699180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a5f7f-c367-4793-bcaa-dcb4017028cf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:43.738767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:43.739514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:43.739883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:43.740282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:43.758555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:43.815199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:43.816600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:43.948833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 542/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:47:43.955364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:44.076721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaed8b-0a88-4336-a98e-60b44955f06c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:44.122171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:44.122837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:44.123116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:44.123386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:44.136919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:44.138673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:47:44.155865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:44.158623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:47:44.159531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:47:44.159531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:47:44.159531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:44.159531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 560/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:47:44.167881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:44.224111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:44.286513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f18320-52de-495d-8fe3-4f46dfc6562c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:44.344563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:44.345551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:44.346037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:44.346521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:44.347701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:44.348258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:44.350872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:44.368603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 543/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:44.374795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:44.399296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:44.494693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34acb7-c628-42c7-861f-c960a67a0839 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:44.537241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:44.537816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:44.538240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:44.538517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:44.547680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:44.549761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:47:44.564563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:47:44.565614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:47:44.566524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 561/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:47:44.573224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:44.697107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2ce34-776e-4b1b-ac56-9fbb2239d8b8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:44.706393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:44.743006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:44.743824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:44.744220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:44.744666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:44.745549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:44.745981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:44.747667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa4769-2de3-4692-886e-96e542e06f3d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:44.765846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 544/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:44.773825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:44.875118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:44.903734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c41a-1924-4daf-b250-5894c6f78506 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:44.947812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:44.948334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:44.948644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:44.948917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:44.949654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] RBAC: Adding query filter params (role.id=cf098d4b63944277b1c33c1b98b12010, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=171bca600dcb4dcba12c02fb3dc67197) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:44.949959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:44.951414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a8c87-0c3c-48e1-af2f-06f532ddb2a7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:44.961005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 562/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:44 2022] GET /identity/v3/role_assignments?user.id=171bca600dcb4dcba12c02fb3dc67197&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=cf098d4b63944277b1c33c1b98b12010 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:45.499088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b377e-355a-4f5a-8d11-548cc1cbae6b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:45.499813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b377e-355a-4f5a-8d11-548cc1cbae6b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:45.499813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b377e-355a-4f5a-8d11-548cc1cbae6b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:45.502622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 545/1107] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:45.510473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:45.510891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:45.511342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:45.538921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:45.545981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:45.679913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 563/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:46.020280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b377e-355a-4f5a-8d11-548cc1cbae6b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:46.193175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b377e-355a-4f5a-8d11-548cc1cbae6b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:46.245854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:46.246510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:46.246793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:46.247070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:46.248300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:46.249821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57121b-83c0-4b01-85fa-0ce77de1c9d2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:46.252288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 546/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:47:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:46.258679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:46.342258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:46.378980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba80bfd-4a80-4cbe-89ea-803ebf9b7002 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:46.420588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:46.421459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:46.421795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:46.422114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:46.423054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:46.424869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe81a1-2977-4af7-9b95-22639e902f20 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:46.556783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 564/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:47:46 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:47:48.881931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87897-e609-4bdf-8a71-ae69b324c58d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:48.886004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87897-e609-4bdf-8a71-ae69b324c58d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:48.886004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87897-e609-4bdf-8a71-ae69b324c58d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:48.886004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 547/1111] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:48.891059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:48.892087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:48.892276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:48.913465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:48.914990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:48.987955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 565/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:49.276298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87897-e609-4bdf-8a71-ae69b324c58d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:49.318972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:49.403538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87897-e609-4bdf-8a71-ae69b324c58d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:49.447698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:49.448349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:49.448663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:49.448939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] PATH_INFO: `/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:49.450479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] RBAC: Authorizing `identity:get_role(role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:49.452002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:49.453438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 548/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:49 2022] GET /identity/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:49.461063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:49.530882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:49.583978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe68f9-6387-4ddf-87d2-aa625cc8e7bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:49.632737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:49.633455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:49.633762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:49.634065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] PATH_INFO: `/v3/users/5867173ac327461cbe048bd8832d5589` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:49.652033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] RBAC: Authorizing `identity:get_user(user_id=5867173ac327461cbe048bd8832d5589)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:49.653680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:49.655556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 566/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:49 2022] GET /identity/v3/users/5867173ac327461cbe048bd8832d5589 => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:49.662617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:49.791589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d7cfa-5d5f-44fa-9ffe-84ae2558bf8d None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:49.794461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:49.855590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:49.856689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:49.857193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:49.857676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:49.979469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:49.982381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:50.118178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 549/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:47:50.128189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:50.240016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf26f1-1b7f-4b0d-bcf9-d63683961823 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:50.256838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:50.278983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:50.279726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:50.280009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:50.280287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:50.281482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:50.283887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148753a3-585f-4ec8-a374-ea37b8267841 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:50.285625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 567/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:50 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:50.292707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:50.294913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:50.406495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fd374-ccd0-4556-b6a3-67ceca420655 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:50.448707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:50.449330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:50.449616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:50.449896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:50.450643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8, user.id=5867173ac327461cbe048bd8832d5589) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:50.450955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:50.452451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e6d89-1103-42ff-ab7c-f774696ef83e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:50.467408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 550/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:50 2022] GET /identity/v3/role_assignments?user.id=5867173ac327461cbe048bd8832d5589&scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:53.015695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5c7-d578-4bc8-aee5-0dd02754d28d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:53.016269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5c7-d578-4bc8-aee5-0dd02754d28d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:53.016370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f5c7-d578-4bc8-aee5-0dd02754d28d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:53.018541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 568/1118] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:47:53.024483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:53.025253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:53.025253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:53.045262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:53.046534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:53.114258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:53.122241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 551/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:53.410948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0f5c7-d578-4bc8-aee5-0dd02754d28d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:53.532830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0f5c7-d578-4bc8-aee5-0dd02754d28d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:53.578172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:53.579827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:53.580320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:53.580842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] PATH_INFO: `/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:53.583400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] RBAC: Authorizing `identity:get_role(role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:53.585972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:53.588449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 569/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:53 2022] GET /identity/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:53.594746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:53.707748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869401aa-e03b-4a41-9a16-9f3733b35299 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:53.750251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:53.751177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:53.751868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:53.752200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] PATH_INFO: `/v3/users/5867173ac327461cbe048bd8832d5589` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:53.753514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] RBAC: Authorizing `identity:get_user(user_id=5867173ac327461cbe048bd8832d5589)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:53.755022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:53.756898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 552/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:53 2022] GET /identity/v3/users/5867173ac327461cbe048bd8832d5589 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:53.763301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:53.819061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:53.872607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ffb06-b2ae-4736-851e-f1ed8c553a1f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:53.933066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:53.933714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:53.933994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:53.934264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:53.935394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:53.936857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99521e9-1244-401c-9124-e9a39e4e9724 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:53.938923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 570/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:53 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:47:53.948162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:54.015788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:54.059222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d125b-abcb-452b-a5c1-f4cdbb07133b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:54.096028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:54.096798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:54.097129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:54.097453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8/users/5867173ac327461cbe048bd8832d5589/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:54.099681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8, user_id=5867173ac327461cbe048bd8832d5589, role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:54.101207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6184c69-d86c-4074-b795-a023bbb6cde1 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:54.230908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 553/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:47:53 2022] PUT /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8/users/5867173ac327461cbe048bd8832d5589/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:47:56.493496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b89ef-c992-43fe-ad63-1591bebc38b3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:56.494078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b89ef-c992-43fe-ad63-1591bebc38b3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:56.494078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b89ef-c992-43fe-ad63-1591bebc38b3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:56.495384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 571/1124] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:47:56.501610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:56.502170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:56.502170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:56.522532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:47:56.523766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:47:56.599072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 554/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:47:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:47:56.879768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b89ef-c992-43fe-ad63-1591bebc38b3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:56.993792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b89ef-c992-43fe-ad63-1591bebc38b3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:57.014016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:57.031693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:57.032612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:57.033036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:57.033371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] PATH_INFO: `/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:57.034902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] RBAC: Authorizing `identity:get_role(role_id=8a42c31ef57443d6aa50924b3bb9cdda)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:57.036293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:57.037708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 572/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:56 2022] GET /identity/v3/roles/8a42c31ef57443d6aa50924b3bb9cdda => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:57.044021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:57.105972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:57.154245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84564b-10de-4424-ac7f-035b8afb8e3d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:57.192843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:57.193500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:57.193786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:57.194061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] PATH_INFO: `/v3/users/5867173ac327461cbe048bd8832d5589` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:57.195400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] RBAC: Authorizing `identity:get_user(user_id=5867173ac327461cbe048bd8832d5589)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:57.196891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:57.198569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 555/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:47:57 2022] GET /identity/v3/users/5867173ac327461cbe048bd8832d5589 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:57.205320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:57.317563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457a67c-e006-49dd-90f3-90d49f4288ad None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:57.356334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:57.357877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:57.357877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:57.357877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:57.418440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:57.432483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:57.433978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:57.543655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 573/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:47:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:47:57.550504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:57.664971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa66a-63de-40e2-826c-cb3ce707b043 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:57.693232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:57.710738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:57.711460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:57.711778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:57.712093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] PATH_INFO: `/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:57.713395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] RBAC: Authorizing `identity:get_project(project_id=ad20e2e0580b4bcdb3d3a1a790f167b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:57.714996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d1ff7-c3ea-42d8-83c8-cc8cc0595abd None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:57.716840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 556/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:47:57 2022] GET /identity/v3/projects/ad20e2e0580b4bcdb3d3a1a790f167b8 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:47:57.726591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:47:57.841720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:57.859018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e836-678b-4a7d-96e6-1fecf4df5b64 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:47:57.906826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:47:57.908007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:47:57.908280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:47:57.908591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:47:57.909411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] RBAC: Adding query filter params (role.id=8a42c31ef57443d6aa50924b3bb9cdda, scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8, user.id=5867173ac327461cbe048bd8832d5589) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:47:57.909721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:47:57.911162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ca8f7-e1e7-408f-857d-910538e3b1f6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:47:57.917889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 574/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:47:57 2022] GET /identity/v3/role_assignments?user.id=5867173ac327461cbe048bd8832d5589&scope.project.id=ad20e2e0580b4bcdb3d3a1a790f167b8&role.id=8a42c31ef57443d6aa50924b3bb9cdda => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:00.247217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea7f7-1d06-4b90-abef-f782c213f9fc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:00.247824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea7f7-1d06-4b90-abef-f782c213f9fc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:00.247824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea7f7-1d06-4b90-abef-f782c213f9fc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:00.249142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 557/1131] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:00.256139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:00.256838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:00.256838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:00.276767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:00.278001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:00.359842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 575/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:00.646876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cea7f7-1d06-4b90-abef-f782c213f9fc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:00.755957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cea7f7-1d06-4b90-abef-f782c213f9fc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:00.794300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:00.794937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:00.795218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:00.795488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:00.796650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:00.798946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf7e1b-aeca-4c7f-bec1-6f408d946073 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:00.800688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 558/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:48:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:00.807274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:00.896134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:00.917246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063bde7-8d47-4d6a-953f-e2444cab97e0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:00.956757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:00.957433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:00.957755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:00.958069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:00.958771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:00.960268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61927b-8d06-4760-9150-45bcf1d434d4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:01.077776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 576/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:48:00 2022] POST /identity/v3/projects => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:03.416108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eab98-d864-434e-b7d0-41fa5a93cbb2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:03.416752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eab98-d864-434e-b7d0-41fa5a93cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:03.416752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eab98-d864-434e-b7d0-41fa5a93cbb2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:03.418206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 559/1135] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:03.425163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:03.425970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:03.425970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:03.445040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:03.446300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:03.519714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 577/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:48:03.852234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eab98-d864-434e-b7d0-41fa5a93cbb2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:03.936432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:03.982985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eab98-d864-434e-b7d0-41fa5a93cbb2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:04.021785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:04.022424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:04.022697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:04.022975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:04.024235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:04.025805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a8a90-4f44-4c32-8c74-12d26dc7badc None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:04.027449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 560/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:48:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:48:04.033930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:04.103685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:04.146798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237fa2-d120-4a91-af1d-5545ec9e2e66 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:04.184295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:04.184952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:04.185238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:04.185512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:04.186190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:04.187630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a57d5e-03ac-4f44-b27d-44ae0724a979 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:04.328871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 578/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:48:04 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:06.696116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9dd8-12b6-438e-9dc2-0bb5c4bc75dd None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:06.696734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9dd8-12b6-438e-9dc2-0bb5c4bc75dd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:06.696734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9dd8-12b6-438e-9dc2-0bb5c4bc75dd None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:06.698207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 561/1139] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:06.705631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:06.706177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:06.706552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:06.731148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:06.732397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:06.815128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 579/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:07.091714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d9dd8-12b6-438e-9dc2-0bb5c4bc75dd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:07.228420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d9dd8-12b6-438e-9dc2-0bb5c4bc75dd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:07.258325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:07.267911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:07.268646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:07.269256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:07.269256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:07.281284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:07.287007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:07.288773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:07.290886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 562/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:07.296426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:07.347981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:07.402149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529488-b74e-4713-a517-e6c096dfd95e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:07.441452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:07.442137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:07.442465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:07.442790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:07.443518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:07.443870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:07.445352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:07.456185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 580/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:07.462448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:07.575412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bacb6-b3e8-4ce5-80d3-689018d4c517 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:07.614289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:07.614944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:07.615226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:07.615500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] PATH_INFO: `/v3/users/c8e2516376be453faace41b32973fa86` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:07.632712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e2516376be453faace41b32973fa86)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:07.634539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:07.636464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 563/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:07 2022] GET /identity/v3/users/c8e2516376be453faace41b32973fa86 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:07.643229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:07.753059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acce13-1264-409c-a805-a1a963d96f26 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:07.764288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:07.793186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:07.793927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:07.794450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:07.794909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:07.872648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:07.874047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:08.003303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 581/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:48:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:48:08.009727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:08.065914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:08.130491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319bda7-c9c3-4ef6-90a1-4dbcc6a68291 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:08.171339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:08.171982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:08.172269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:08.172563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] PATH_INFO: `/v3/projects/592d94499ceb49aeb9e03768c1a0befd` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:08.174085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] RBAC: Authorizing `identity:get_project(project_id=592d94499ceb49aeb9e03768c1a0befd)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:08.175580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623327f8-c389-4078-993d-2e51d51b312c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:08.177300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 564/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:08 2022] GET /identity/v3/projects/592d94499ceb49aeb9e03768c1a0befd => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:08.183741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:08.196595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:08.322251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e281b-ec42-4645-92ab-c89a98967bef None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:08.359950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:08.360676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:08.361006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:08.361318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:08.362105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=592d94499ceb49aeb9e03768c1a0befd, user.id=c8e2516376be453faace41b32973fa86) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:08.362457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:08.364054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bd2dd-d138-4e89-b7bc-03505aa48f6c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:08.370385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 582/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:48:08 2022] GET /identity/v3/role_assignments?user.id=c8e2516376be453faace41b32973fa86&scope.project.id=592d94499ceb49aeb9e03768c1a0befd&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:48:10.589870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba508f-0521-4e70-bcbb-0cdac52972a8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.590440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba508f-0521-4e70-bcbb-0cdac52972a8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.590440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba508f-0521-4e70-bcbb-0cdac52972a8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.591757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 565/1147] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:10.599016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.599658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.599658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.618763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:10.619959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:10.695590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 583/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:10.972755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba508f-0521-4e70-bcbb-0cdac52972a8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.167175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba508f-0521-4e70-bcbb-0cdac52972a8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.191626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.216361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.217114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.217349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.217627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.230677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:11.236954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:11.238156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:11.239224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 566/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:11.244556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.247800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.354868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a533142-7305-4b2f-81d5-fafdd3782b02 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.392392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.393096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.393486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.393768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.394445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:11.394753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:11.396133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:11.408953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 584/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:11.415301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.541856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615e0b2-4f37-4a97-9d14-2ad859111fcd None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.581129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.581766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.582204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.582488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] PATH_INFO: `/v3/users/c8e2516376be453faace41b32973fa86` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.583634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e2516376be453faace41b32973fa86)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:11.585112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:11.586691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 567/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:11 2022] GET /identity/v3/users/c8e2516376be453faace41b32973fa86 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:11.592767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.664373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.701648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18c22-733c-4d84-9a5b-cc0fd91d2146 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.736459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.737320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.737598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.737872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] PATH_INFO: `/v3/projects/592d94499ceb49aeb9e03768c1a0befd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.739065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=592d94499ceb49aeb9e03768c1a0befd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:11.740504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488b472-1e70-4768-a169-77cb7e8ee3e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:11.742193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 585/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:11 2022] GET /identity/v3/projects/592d94499ceb49aeb9e03768c1a0befd => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:11.748272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.810887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.875135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40866a0d-88d6-4a9c-a5f0-a42a8ebd3d19 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.912929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.913601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.913880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.914155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] PATH_INFO: `/v3/projects/592d94499ceb49aeb9e03768c1a0befd/users/c8e2516376be453faace41b32973fa86/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.916341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=592d94499ceb49aeb9e03768c1a0befd, user_id=c8e2516376be453faace41b32973fa86, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:11.917816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709228-97d4-41bb-8d38-45e3f6131c25 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:12.037981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 568/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:48:11 2022] PUT /identity/v3/projects/592d94499ceb49aeb9e03768c1a0befd/users/c8e2516376be453faace41b32973fa86/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:48:14.291688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627f0b7-96cd-4285-94e0-48b81833724d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:14.292243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627f0b7-96cd-4285-94e0-48b81833724d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:14.292243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627f0b7-96cd-4285-94e0-48b81833724d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:14.293603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 586/1154] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:48:14.299672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:14.300191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:14.300290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:14.320097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:14.321432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:14.395162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 569/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:14.692730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627f0b7-96cd-4285-94e0-48b81833724d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:14.799955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627f0b7-96cd-4285-94e0-48b81833724d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:14.836710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:14.837406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:14.837742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:14.838058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:14.840185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:14.850608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:14.855529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:14.896879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:48:14.898081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 587/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:14.898790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:14.898790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:14.971412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc56c7f-7c52-424b-9549-c4ff4c002fc4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:15.008267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:15.009129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:15.009408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:15.009676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:15.010346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:15.010646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:15.012116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:15.021978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 570/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:15.031101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:15.146330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ec03-ea94-42b2-9761-52b6e7ead134 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:15.184374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:15.185056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:15.185341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:15.185619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] PATH_INFO: `/v3/users/c8e2516376be453faace41b32973fa86` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:15.186769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e2516376be453faace41b32973fa86)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:15.188845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:15.190584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 588/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:15 2022] GET /identity/v3/users/c8e2516376be453faace41b32973fa86 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:15.196562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:15.293797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:15.303995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa19bad-ac1d-4483-bc36-e395b02c83a2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:15.346377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:15.347056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:15.347384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:15.347702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:15.429407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:15.430998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:15.540697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:15.552351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 571/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:48:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:48:15.561941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:15.654192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:15.697361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b9752-4156-44f0-9109-c90814898192 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:15.736974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:15.737632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:15.737916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:15.738197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] PATH_INFO: `/v3/projects/592d94499ceb49aeb9e03768c1a0befd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:15.739474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] RBAC: Authorizing `identity:get_project(project_id=592d94499ceb49aeb9e03768c1a0befd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:15.740970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae5e7f-9acb-408c-814c-adf2237340f1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:15.742774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 589/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:15 2022] GET /identity/v3/projects/592d94499ceb49aeb9e03768c1a0befd => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:15.749327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:15.860068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040f899-2ef3-444a-95bf-90a53f0baf6f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:15.897199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:15.897871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:15.898267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:15.898698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:15.899528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=592d94499ceb49aeb9e03768c1a0befd, user.id=c8e2516376be453faace41b32973fa86) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:15.899847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:15.901340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c288-03ee-4b33-9122-34cf8d5e6c52 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:15.908665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 572/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:48:15 2022] GET /identity/v3/role_assignments?user.id=c8e2516376be453faace41b32973fa86&scope.project.id=592d94499ceb49aeb9e03768c1a0befd&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:18.241120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c27c3-9c38-4866-92a4-18578e362dbb None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:18.241699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c27c3-9c38-4866-92a4-18578e362dbb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:18.241699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c27c3-9c38-4866-92a4-18578e362dbb None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:18.243011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 590/1162] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:48:18.248860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:18.249275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:18.249475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:18.269411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:18.271030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:18.327403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:18.345777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 573/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:18.642018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c27c3-9c38-4866-92a4-18578e362dbb None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:18.754071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c27c3-9c38-4866-92a4-18578e362dbb None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:18.786730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:18.793308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:18.795729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:18.795729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:18.795729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:18.880658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:18.883026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:19.026351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 591/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:48:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:48:19.033461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:19.143078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba5e3f-1927-4515-ab99-a01dbc18e022 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:19.182527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:19.183229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:19.183557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:19.183882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:19.192432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:19.194023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-a3531b7e-f6cd-4d1f-81b1-af9c235cdc97 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:19.208235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:19.210339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:19.212065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 574/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:48:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:19.217311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:19.252169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:19.377887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba291a-54b7-4d8f-a481-ca4f8e72114e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:19.433130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:19.433753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:19.434037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:19.434310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:19.434956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:19.435257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:19.436654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784216c-65d0-489b-85f6-25de2d7166a9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:19.445917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 592/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Sep 8 13:48:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:21.729581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547781e7-82c6-49df-8012-77b49861b28a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:21.730188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547781e7-82c6-49df-8012-77b49861b28a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:21.730188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547781e7-82c6-49df-8012-77b49861b28a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:21.731470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 575/1167] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:21.737388 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602091b9-c8d8-472a-b114-62ad1978cc63 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:21.737933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602091b9-c8d8-472a-b114-62ad1978cc63 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:21.737933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602091b9-c8d8-472a-b114-62ad1978cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:21.756813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-602091b9-c8d8-472a-b114-62ad1978cc63 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:21.758020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-602091b9-c8d8-472a-b114-62ad1978cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:21.839319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 593/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:48:22.113448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547781e7-82c6-49df-8012-77b49861b28a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:22.166449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:22.226461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547781e7-82c6-49df-8012-77b49861b28a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:22.264593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:22.265216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:22.265502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:22.265784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:22.266503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:22.267886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d6704-f714-4a17-be3e-a9b98a38e98e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:22.455868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 576/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Thu Sep 8 13:48:22 2022] POST /identity/v3/domains => generated 267 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:48:24.794573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250c1c-5a85-426a-b0ff-87485e16d741 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:24.795173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250c1c-5a85-426a-b0ff-87485e16d741 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:24.795173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99250c1c-5a85-426a-b0ff-87485e16d741 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:24.796450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 594/1170] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:24.803338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:24.804089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:24.804089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:24.823672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:24.824927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:24.902179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 577/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:25.185945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99250c1c-5a85-426a-b0ff-87485e16d741 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:25.215662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:25.322071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99250c1c-5a85-426a-b0ff-87485e16d741 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:25.382926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:25.399927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:25.399927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:25.399927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] PATH_INFO: `/v3/domains/644e334a97fd4754a39bcb22b486129b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:25.405739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=644e334a97fd4754a39bcb22b486129b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:25.408375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf98fb-486e-4628-9935-9315c4d2a4ac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:25.411484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 595/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Sep 8 13:48:25 2022] GET /identity/v3/domains/644e334a97fd4754a39bcb22b486129b => generated 267 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:25.421110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:25.472106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:25.552665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b8a0-5604-4c01-9bd3-0ad3d5d7025a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:25.598094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:25.598777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:25.599105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:25.599427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:25.600139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:25.601690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e68508-c89d-46dd-a3d3-fffafe8bc0bb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:25.706818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 578/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:48:25 2022] POST /identity/v3/projects => generated 361 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:28.235191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899cf8-ea2e-462d-a1f9-5fd6d433c995 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:28.235759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899cf8-ea2e-462d-a1f9-5fd6d433c995 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:28.235759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68899cf8-ea2e-462d-a1f9-5fd6d433c995 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:28.237325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 596/1174] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:28.245518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:28.246287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:28.246287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:28.265497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:28.267044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:28.351232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 579/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:28.627231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899cf8-ea2e-462d-a1f9-5fd6d433c995 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:28.722237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:28.745492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68899cf8-ea2e-462d-a1f9-5fd6d433c995 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:28.800603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:28.801251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:28.801534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:28.801807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] PATH_INFO: `/v3/domains/644e334a97fd4754a39bcb22b486129b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:28.802976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=644e334a97fd4754a39bcb22b486129b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:28.804425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9939d8a-3dfb-4e14-bc46-b8291648e113 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:28.806047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 597/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Sep 8 13:48:28 2022] GET /identity/v3/domains/644e334a97fd4754a39bcb22b486129b => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:28.811959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:28.832832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:28.926814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931f1b3-48c4-4f6a-9caf-e8bccf9a5918 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:28.967589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:28.967589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:28.967822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:28.968039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:28.968817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:28.971317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ddcfa-6ae7-47aa-b121-f4215b83044c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:29.201943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 580/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:48:28 2022] POST /identity/v3/users => generated 311 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:31.529028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852f27-d416-4f22-bac2-1437df1426f9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:31.529857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852f27-d416-4f22-bac2-1437df1426f9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:31.530062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852f27-d416-4f22-bac2-1437df1426f9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:31.531533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 598/1178] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:48:31.538025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:31.538571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:31.538571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:31.559024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:31.560294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:31.634193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 581/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:31.912892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852f27-d416-4f22-bac2-1437df1426f9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:32.028868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852f27-d416-4f22-bac2-1437df1426f9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:32.068387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:32.069081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:32.069363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:32.069642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:32.083116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:32.088238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:32.090123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:48:32.091159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 599/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:48:32.100345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:32.105464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.219067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713ae68-7708-4c49-a087-d4853d5c9dec None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:32.258415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:32.259025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:32.259303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:32.259574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:32.260240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:32.260596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:32.261991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:32.271742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 582/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:32.278110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:32.295219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.401556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de4c9-3958-49b3-bd1b-da5f052ce7e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:32.440800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:32.441454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:32.441731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:32.441998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] PATH_INFO: `/v3/users/795955beb1e24daf93908e88e4432d55` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:32.458138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] RBAC: Authorizing `identity:get_user(user_id=795955beb1e24daf93908e88e4432d55)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:32.459607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:32.461410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 600/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:32 2022] GET /identity/v3/users/795955beb1e24daf93908e88e4432d55 => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:32.467586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:32.540866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.584643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb4dd-2772-4bd8-9a7c-89b94953c427 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:32.622545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:32.623167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:32.623443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:32.623711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:32.698405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:32.699877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:32.769068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.808406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 583/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:48:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:48:32.815543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:32.904173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.937754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d54e1-9333-47c2-aaf5-94f14c225c85 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:32.979942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:32.980766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:32.981088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:32.981404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] PATH_INFO: `/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:32.982835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c9fec8dd26844e86b2a833a5a007a9b8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:32.984451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3820-ae5b-45cd-bbf4-7ee7baa440a8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:32.987391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 601/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:32 2022] GET /identity/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:32.994334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:33.110039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3c6ea-b3bd-4226-9ef6-662e28b64e64 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:33.147265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:33.147872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:33.148150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:33.148424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:33.149191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=c9fec8dd26844e86b2a833a5a007a9b8, user.id=795955beb1e24daf93908e88e4432d55) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:33.149495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:33.150931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6fc7e-0a1b-479a-afa5-5d7695f6925e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:33.157984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 584/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:48:32 2022] GET /identity/v3/role_assignments?user.id=795955beb1e24daf93908e88e4432d55&scope.project.id=c9fec8dd26844e86b2a833a5a007a9b8&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:35.400930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eaddc-b5ed-41a3-9783-780aae6b6d48 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:35.401563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eaddc-b5ed-41a3-9783-780aae6b6d48 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:35.401694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eaddc-b5ed-41a3-9783-780aae6b6d48 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:35.403007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 602/1186] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:35.409667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:35.410183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:35.410273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:35.429560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:35.430866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:35.458406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:35.513024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 585/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:48:35.785446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eaddc-b5ed-41a3-9783-780aae6b6d48 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:35.897016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eaddc-b5ed-41a3-9783-780aae6b6d48 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:35.932213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:35.932877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:35.933154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:35.933427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:35.940730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:35.944848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:35.949729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:35.950852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:48:35.952068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 603/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:35.959564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:36.074795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5c8bc-a6de-4c31-a4c3-faaf138a87a2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:36.114948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:36.115559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:36.115838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:36.116116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:36.116803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:36.117104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:36.118467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:36.127595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 586/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:36.133521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:36.238067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84871cf-a62e-4592-a820-dcee514d958b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:36.285593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:36.286243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:36.286523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:36.286802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] PATH_INFO: `/v3/users/795955beb1e24daf93908e88e4432d55` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:36.287963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] RBAC: Authorizing `identity:get_user(user_id=795955beb1e24daf93908e88e4432d55)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:36.289446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:36.291350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 604/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:36 2022] GET /identity/v3/users/795955beb1e24daf93908e88e4432d55 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:36.297387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:36.323849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:36.403986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae54ef0-34a3-488d-a244-8aa99a20755c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:36.445267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:36.445964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:36.446193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:36.446471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] PATH_INFO: `/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:36.447660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] RBAC: Authorizing `identity:get_project(project_id=c9fec8dd26844e86b2a833a5a007a9b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:36.449142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc771-f69e-4657-8dea-e7772ff27c91 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:36.450796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 587/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:36 2022] GET /identity/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:36.460977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:36.528688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:36.564468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b27c-a9c3-4200-8312-b252dea7a015 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:36.599815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:36.600478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:36.600791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:36.601068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] PATH_INFO: `/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8/users/795955beb1e24daf93908e88e4432d55/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:36.602971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9fec8dd26844e86b2a833a5a007a9b8, user_id=795955beb1e24daf93908e88e4432d55, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:36.604395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d0fb5-dad8-455b-ac0b-9c79189e56f7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:36.694032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 605/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:48:36 2022] PUT /identity/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8/users/795955beb1e24daf93908e88e4432d55/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:48:38.934600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d25a8-bf33-452e-a52c-9d53ab0e31bc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:38.935142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d25a8-bf33-452e-a52c-9d53ab0e31bc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:38.935272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d25a8-bf33-452e-a52c-9d53ab0e31bc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:38.936661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 588/1193] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:38.943333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:38.943865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:38.943865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:38.963538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:38.964787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:39.035244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 606/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:48:39.314681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d25a8-bf33-452e-a52c-9d53ab0e31bc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:39.412494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:39.423520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d25a8-bf33-452e-a52c-9d53ab0e31bc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:39.464076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:39.464752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:39.465036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:39.465310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:39.476255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:48:39.481233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:48:39.482520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:48:39.483462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 589/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:48:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:48:39.489409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:39.555849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:39.607074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604dc5c-59e1-424f-8fcc-c29689322d25 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:39.650293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:39.650918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:39.651202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:39.651482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:39.652156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:39.652465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:39.653896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:39.663197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 607/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:48:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:39.669534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:39.785880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74387-faee-4e65-b5f6-b60fdc0e7e41 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:39.828592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:39.829545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:39.830147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:39.830557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] PATH_INFO: `/v3/users/795955beb1e24daf93908e88e4432d55` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:39.831899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] RBAC: Authorizing `identity:get_user(user_id=795955beb1e24daf93908e88e4432d55)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:39.833402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:39.835079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 590/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Sep 8 13:48:39 2022] GET /identity/v3/users/795955beb1e24daf93908e88e4432d55 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:39.841604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:39.964007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e679c-00fa-4f3c-adc6-ea3f4fd475df None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:39.982619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:40.001278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:40.001918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:40.002202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:40.002481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:40.079302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:40.080882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:40.213609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 608/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:48:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:48:40.220447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:40.240472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:40.363872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5023965-7d39-4a30-83dc-2ef27a108061 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:40.407383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:40.408142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:40.408731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:40.409017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] PATH_INFO: `/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:40.410369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] RBAC: Authorizing `identity:get_project(project_id=c9fec8dd26844e86b2a833a5a007a9b8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:40.411956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f1aa-61ad-474c-83dd-110cb30e19bb None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:40.413793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 591/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Sep 8 13:48:40 2022] GET /identity/v3/projects/c9fec8dd26844e86b2a833a5a007a9b8 => generated 361 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:48:40.420856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:40.445771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:40.553323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46492cd3-36c7-4d5b-be78-388fc5fbeee6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:40.591358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:40.591971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:40.592248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:40.592540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:40.593281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=c9fec8dd26844e86b2a833a5a007a9b8, user.id=795955beb1e24daf93908e88e4432d55) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:40.593587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:40.595465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44f7c5-baed-4eba-bd65-e4a2636376fe None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:40.602588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 609/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:48:40 2022] GET /identity/v3/role_assignments?user.id=795955beb1e24daf93908e88e4432d55&scope.project.id=c9fec8dd26844e86b2a833a5a007a9b8&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:48:50.402257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=57 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:50.599616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=59 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:10.506928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef437e-1ef8-4925-b16a-7be49a14de39 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:10.507711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef437e-1ef8-4925-b16a-7be49a14de39 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:10.507711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef437e-1ef8-4925-b16a-7be49a14de39 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:10.508936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 592/1201] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:10.514377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:10.515807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:10.515807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:10.533591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:10.534790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:10.606204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 610/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:10.883005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef437e-1ef8-4925-b16a-7be49a14de39 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:10.994604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef437e-1ef8-4925-b16a-7be49a14de39 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:11.030976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:11.031619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:11.031902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:11.032181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:11.042715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:11.044154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:11.063446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:11.066617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:11.067878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:11.067878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:11.067878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:11.067878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 593/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:11.071383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:11.185139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e014d-1ff5-4041-9882-02b6223c6d0e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:11.215071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:11.221614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:11.222257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:11.222532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:11.222802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:11.223448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:11.223750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:11.225210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf441e-2706-4798-93af-a123f0a52643 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:11.237218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 611/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:11.243180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:11.301297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:11.354655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13977-d705-4c9d-8a4d-2f0bb629681f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:11.388998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:11.389617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:11.390585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:11.391049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:11.392267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:11.394991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f12f7-7251-4bcf-a303-a048a37b454d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:11.555238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 594/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Sep 8 13:50:11 2022] POST /identity/v3/users => generated 251 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:50:13.802969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6bda-f040-4d22-9951-2d64b2615a0d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:13.803549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6bda-f040-4d22-9951-2d64b2615a0d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:13.803549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6bda-f040-4d22-9951-2d64b2615a0d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:13.804912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 612/1206] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:13.810504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:13.810942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:13.811211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:13.830621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:13.831818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:13.900442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 595/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:14.177757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e6bda-f040-4d22-9951-2d64b2615a0d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.284091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e6bda-f040-4d22-9951-2d64b2615a0d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.322796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:14.323434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.323714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.323985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.335008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:14.339828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:14.340996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:14.342021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 613/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:14.347162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.388427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:14.455712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62789cf7-a75f-4c8d-b054-5dade15170d2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.490260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:14.490880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.491163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.491438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.492103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:14.492406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:14.493816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:14.502937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 596/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:14.508912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.568322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:14.619402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af709-a322-4e92-bbeb-25095f29d860 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.655588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:14.656423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.656586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.656841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.666889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:14.668731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:14.684029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:14.692499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:14.693654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:14.693654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:14.693654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:14.693654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 614/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:14.693941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.801223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:14.804276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee57c9-e068-4aa4-a3f9-667c3aba7b05 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.845785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:14.846480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.846668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.846942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.847586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:14.847889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:14.849286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:14.862600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 597/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:14.868768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.973273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d4d-1f99-4728-8cbb-8f7841f28984 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.974839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:15.008789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:15.009507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:15.009808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:15.010078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:15.018005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:15.019433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:15.031814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:15.033099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:15.034368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 615/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:15.039081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:15.164259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c08ab-8385-4492-8d73-daae696477c2 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:15.224098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:15.224784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:15.225073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:15.225346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:15.226100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:15.226408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:15.228163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:15.249472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 598/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:50:15.255742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:15.385903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4befef-3e18-40cb-9668-441a352f026f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:15.426233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:15.426928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:15.427353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:15.427718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:15.459946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:15.498835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:15.501335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:15.599368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 616/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:50:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:15.605542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:15.629885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:15.724213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf2612-e986-4128-8c9f-a984050583ec None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:15.766031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:15.766749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:15.767038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:15.767316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:15.778707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:15.780219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:15.797143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:15.799023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:15.801112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:15.801112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:15.801112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:15.801112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 599/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:15.805530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:15.867371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:15.905602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168f51f-2395-440d-9775-a8f072e7461e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:15.940221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:15.941339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:15.943086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:15.943373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:15.945207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:15.945527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:15.952124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:15.960309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 617/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:15.966375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:16.038986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:16.070184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfb2-0789-4a2d-9750-2fdb9d126b2b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:16.105809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:16.106445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.106727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.107054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.114809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:16.116282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:16.127879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:16.134901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:16.136077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 600/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:16.136742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:16.236865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2a26f-2ba3-446c-b41e-f7c213b5a513 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:16.259621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:16.271462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:16.272073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.272357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.272665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.273360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:16.273679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:16.275132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d1a81-5d89-41ac-b3fc-3f2ae4cd6137 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:16.286758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 618/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:16.293442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:16.395955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf532e-1c6a-4e13-80ab-fee4e562c97e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:16.425380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:16.431105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:16.431719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.432000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.432273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.433033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=ebc702da0b654042a0f5526ea47ef536) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:16.433346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:16.434775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5fa3-8bdf-4a8f-9039-ce308ed85c76 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:16.441070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 601/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:50:16 2022] GET /identity/v3/role_assignments?user.id=ebc702da0b654042a0f5526ea47ef536&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:18.616161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf32a8-1224-4d54-a631-c602c2e7ae96 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:18.616741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf32a8-1224-4d54-a631-c602c2e7ae96 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:18.616741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf32a8-1224-4d54-a631-c602c2e7ae96 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:18.618096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 619/1220] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:18.623603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:18.624735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:18.632697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:18.643441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:18.644700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:18.714081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 602/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:18.991481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf32a8-1224-4d54-a631-c602c2e7ae96 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.104626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf32a8-1224-4d54-a631-c602c2e7ae96 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.139566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.140872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.141157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.141438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.152495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:19.158490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:19.161271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:19.162346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 620/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:19.166107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.271546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e2009-3073-417f-ac2c-7d83f906e006 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.296192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:19.306895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.307537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.307819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.308094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.308791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] RBAC: Adding query filter params (name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:19.309095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:19.310465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:19.318691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 603/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:19.324501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.368324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:19.426650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037939e-600a-4a2a-a7c7-873c841a970e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.461989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.462622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.462902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.463177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.474676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:19.477797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:19.491334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:19.492554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:19.493698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:19.493698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:19.493698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:19.493698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 621/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:19.499906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.612116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2061c3-d3a1-4818-a0d0-b9a31f38f27b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.647907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.648674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.648808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.649076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.649719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:19.650016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:19.651458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:19.663468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 604/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:19.669608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.766155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:19.772717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b8845-7db7-4e0c-b545-74e9350e616b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.805312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.805940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.806218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.806488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.814219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:19.815692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:19.829676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:19.830898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:19.832102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 622/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:19.839089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:19.893485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:19.948025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b67b-b0ad-4c87-8586-1b219d3a0ccf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:19.981470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:19.982084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:19.982367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:19.982644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:19.983957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:19.984493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:19.986672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.008019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 605/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:20.014150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:20.115633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d08db-2144-4afc-9bb5-c36ef0386836 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:20.150095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:20.150652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.150931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.151202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.163219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:20.164689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:20.179750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:20.181071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:20.182162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:20.182162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:20.182162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:20.182162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 623/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:20.187706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:20.286567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb88d-1ba9-48e3-bb63-b0f952e69537 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:20.288871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:20.321590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:20.322215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.322474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.322747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.323378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:20.323678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:20.325098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.337203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 606/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:20.342993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:20.352654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:20.441979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0151d-a80b-48b7-b54f-1d598b592ce8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:20.475353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:20.475971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.476249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.476527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.482867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:20.484476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:20.495787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:20.507004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:20.507927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 624/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:20.508487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:20.605873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85236d-c3ee-48e2-bf5f-e4028aa64cd7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:20.641096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:20.641700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.641978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.642244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.642929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:20.643229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:20.644666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d1a6a-07d6-464c-8570-e3927a82e321 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.656882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 607/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:20.662968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:20.730138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:20.765998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45be1ba-80ad-405e-a81e-4d84b567f5de None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:20.799799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:20.800465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.800780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.801058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/ebc702da0b654042a0f5526ea47ef536/roles/3d35608f1d734509b4095ce947c72c9a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.815339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=ebc702da0b654042a0f5526ea47ef536, role_id=3d35608f1d734509b4095ce947c72c9a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:20.816873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93b8d-f7c8-42f8-a5fa-baf7fa2a1519 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:20.939016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 625/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:50:20 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/ebc702da0b654042a0f5526ea47ef536/roles/3d35608f1d734509b4095ce947c72c9a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:50:23.162795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23609b5-5607-44e1-89a8-0d715965a97c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:23.163391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23609b5-5607-44e1-89a8-0d715965a97c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:23.163391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23609b5-5607-44e1-89a8-0d715965a97c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:23.164824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 608/1233] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:23.173165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:23.173165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:23.173165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:23.190118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:23.191314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:23.258580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 626/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:23.528146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23609b5-5607-44e1-89a8-0d715965a97c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:23.554095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:23.635635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23609b5-5607-44e1-89a8-0d715965a97c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:23.674710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:23.675343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:23.675620 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:23.675890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:23.686006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:23.694223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:23.695424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:23.696830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 609/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Sep 8 13:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:23.698387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:23.745228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:23.798845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f6e2d-0a1e-49b5-900c-6bf7ea3ba744 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:23.833685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514622c-b765-499f-871c-0a393f133951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514622c-b765-499f-871c-0a393f133951 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514622c-b765-499f-871c-0a393f133951 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514622c-b765-499f-871c-0a393f133951 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514622c-b765-499f-871c-0a393f133951 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514622c-b765-499f-871c-0a393f133951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:23.837632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514622c-b765-499f-871c-0a393f133951 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:23.846276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 627/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Sep 8 13:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:23.852358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:23.940339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:23.957347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c3f0-86d1-4b4c-9b1b-320d39dd52cf None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:23.991445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:23.992082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:23.992367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:23.992683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.003526 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:24.005030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:24.020826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:24.021982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:24.023161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:24.023161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:24.023161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:24.023161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 610/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:24.027859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514622c-b765-499f-871c-0a393f133951 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.134158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514622c-b765-499f-871c-0a393f133951 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.144049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.168591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.169204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.169523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.169763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.170402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:24.170741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:24.172351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:24.183886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 628/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:50:24.190529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.296452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c6a85-e6ba-4b3b-9692-5a077e4af1a8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.332039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.332698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.334875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.334875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.336012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.341129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:24.342574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:24.353837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:24.354938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:24.355928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 611/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:24.361676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.463194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5898-9cce-462f-8737-12023f175301 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.497364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.497976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.498251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.498522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.499853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:24.500158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:24.501604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:24.519884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 629/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:24.525987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.631142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b51438-2a76-4e52-b2e8-9bb7b3564ac7 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.666075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.666683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.666965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.667585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.730132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.738837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:24.740298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:24.837764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 612/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:24.844407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.873005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.955948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7150d-bc20-4381-be2b-1e607d0547db None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.991648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.992216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.992493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.992796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:25.004461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.006043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:25.028033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:25.029318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:25.030465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:25.030465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:25.030465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:25.030465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 630/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:25.036502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:25.133385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:25.139156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb535-67d0-4b89-a4ec-d3da4d28478c None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:25.174224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:25.174851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:25.175134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:25.175467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:25.176120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:25.176424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.177822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.189329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 613/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:25.195273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:25.274007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:25.302649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a648304-fff5-4acf-b145-b799364bde98 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:25.347150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:25.347790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:25.348076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:25.348349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:25.355246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.356732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:25.367999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:25.369220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:25.370502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 631/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:25.375489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:25.477662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd0252-8c74-4240-9995-84a9c908499a None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:25.510583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:25.511201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:25.511494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:25.511757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:25.512450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:25.512785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.514373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2ea5f-88ed-4488-a555-799093b5d25f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.526207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 614/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:25.532907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:25.636864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a48a-3ffd-47bf-9e2d-32e106d48683 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:25.675763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] RBAC: Adding query filter params (role.id=3d35608f1d734509b4095ce947c72c9a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=ebc702da0b654042a0f5526ea47ef536) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.681748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e643b7a-838a-44c1-bfd3-d0253959f2a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.685321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 632/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:50:25 2022] GET /identity/v3/role_assignments?user.id=ebc702da0b654042a0f5526ea47ef536&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=3d35608f1d734509b4095ce947c72c9a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:27.900907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e61d-1d13-4678-afc2-18f75a7f91e2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:27.901465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e61d-1d13-4678-afc2-18f75a7f91e2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:27.901465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e61d-1d13-4678-afc2-18f75a7f91e2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:27.902788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 615/1247] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:27.908477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:27.908926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:27.909062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:27.915437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:27.928734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:27.929997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:28.004290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 633/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:28.285781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e61d-1d13-4678-afc2-18f75a7f91e2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:28.304317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:28.389047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e61d-1d13-4678-afc2-18f75a7f91e2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:28.424810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:28.425444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:28.425721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:28.425990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:28.436223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:28.441050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:28.442170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:28.443078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 616/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:28.448313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:28.550761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fd565-40ec-4253-8a44-bd6f5067e0f1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:28.580620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:28.585668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:28.586285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:28.586569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:28.586847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:28.587516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:28.587824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:28.589242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:28.597446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 634/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:28.603745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:28.687916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:28.712112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665430d-c19d-402e-beff-10d29ca115ca None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:28.751506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:28.752140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:28.752417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:28.752713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:28.762859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:28.764343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:28.779305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:28.780424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:28.786451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:28.786451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:28.786451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:28.786451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 617/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:28.786742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:28.896898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34047a-39b2-4085-9607-4dbfb6a210fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:28.933155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:28.938413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:28.949197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 635/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:28.955358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:29.055391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47a028-f400-467a-9cc5-1cb92bdd79ca None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:29.081410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:29.089002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:29.089626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:29.089908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:29.090187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:29.098328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:29.099765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:29.114640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:29.115698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:29.117016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 618/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:29.121770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:29.178344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:29.222929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf04043-e824-4cf7-babc-da29a765dbad None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:29.258275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:29.258891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:29.259172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:29.259444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:29.260170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:29.260478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:29.261948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:29.280201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 636/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:29.285690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:29.387077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1376ba-28d3-4578-94b6-e1020d3d4267 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:29.422538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:29.423144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:29.423425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:29.423700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:29.477559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:29.489954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:29.491394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:29.589031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 619/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:50:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:29.595367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:29.695119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3995-652e-40bd-a4bc-fed239f78c5f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:29.709585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:29.730118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:29.730675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:29.730951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:29.731221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:29.746784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:29.748240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:29.763294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:29.764620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:29.765843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:29.765843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:29.765843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:29.765843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 637/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:29.770519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:29.859274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:29.871313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b882b-7b4d-4411-ab5b-7f3186143fd0 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:29.906309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:29.906916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:29.907195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:29.907467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:29.908113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:29.908412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:29.909812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:29.921852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 620/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:29.927801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:30.030556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf4f6-eeda-47dd-8bdd-850aa66e5b61 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:30.064853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:30.065478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:30.065756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:30.066029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:30.072567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:30.076009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:30.086230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:30.087239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:30.088363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 638/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:30.094322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:30.205556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11139f-fdad-46b6-a644-20ab6016708e None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:30.241878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404657d-2468-458d-95a3-91d68534355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:30.242493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404657d-2468-458d-95a3-91d68534355a None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:30.242774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404657d-2468-458d-95a3-91d68534355a None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:30.243047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404657d-2468-458d-95a3-91d68534355a None admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:30.243882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404657d-2468-458d-95a3-91d68534355a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:30.244187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404657d-2468-458d-95a3-91d68534355a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:30.245652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404657d-2468-458d-95a3-91d68534355a None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:30.258612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 621/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:50:30.265157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:30.291630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:30.366689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5feb7-41ca-46ed-b286-4d4960f0c356 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:30.402065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:30.402668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:30.402949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:30.403224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:30.403958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=ebc702da0b654042a0f5526ea47ef536) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:30.404267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:30.406355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb0af8-9269-4036-b8fb-78c35f5df9e9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:30.411775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 639/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:50:30 2022] GET /identity/v3/role_assignments?user.id=ebc702da0b654042a0f5526ea47ef536&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:32.644527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb319a2-0b03-421b-956d-9e940720f667 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:32.645129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb319a2-0b03-421b-956d-9e940720f667 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:32.645129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb319a2-0b03-421b-956d-9e940720f667 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:32.646427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 622/1261] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:32.651645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:32.652069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:32.652210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:32.671168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:32.672375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:32.739479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 640/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:33.015198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb319a2-0b03-421b-956d-9e940720f667 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.026095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.118770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb319a2-0b03-421b-956d-9e940720f667 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.152909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.153540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.153819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.154094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.164860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:33.169882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:33.171106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:33.172220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 623/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:33.177575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.196944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.294896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1305d4-9221-4c56-8076-7e6849ad65ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.332305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.332948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.333231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.333503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.334164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:33.334470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:33.335858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:33.344350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 641/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:50:33.350203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.418503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.451912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05262-f903-47a3-aad5-0cdcc9925475 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.485806 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.486441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.486722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.486994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.496979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:33.498417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:33.514278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:33.516105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:33.517829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:33.517829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:33.517829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:33.517829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 624/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:33.521539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.603191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.625205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a49d-d53c-4119-9c16-91288761eab5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.658809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.659500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.659692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.659961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.660746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:33.661048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:33.662429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:33.674679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 642/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:33.680500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.786306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc0dee-e430-4e1e-9c53-b048a733525b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.808988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.822943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.823590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.823869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.824141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.832567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:33.834033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:33.846021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:33.847218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:33.848384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 625/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:33.857018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:33.959526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbdd97-c410-466f-98c5-f93908599d41 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:33.994983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:33.995592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:33.995872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:33.996145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:33.996898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:33.997206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:33.999262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:34.008383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:34.016905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 643/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:34.022948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:34.125005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06e65a-109d-4aca-8975-e1eb9158ba73 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:34.158706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:34.159335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.159712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.160000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.171372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:34.172847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:34.188045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:34.193906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:34.194990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:34.194990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:34.194990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:34.194990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 626/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:34.195374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:34.303468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b73c6-5ed9-4c48-85db-70e2e2a325e7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:34.338455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:34.339075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.339358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.339632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.340281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:34.340621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:34.342053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:34.354541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 644/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:34.360766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:34.392914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:34.475412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b9820-3033-40ad-8d95-d9744415ac21 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:34.517762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:34.518416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.518810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.519085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.526450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:34.527897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:34.540020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:34.541136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:34.542109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 627/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:34.547918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:34.611088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:34.657149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24cd1a-a9e2-49d0-b5c9-b8836eb7069e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:34.691264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:34.691957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.692142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.692413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.693136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:34.693437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:34.694934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844368c-819b-4f27-aea8-7c72824da9de None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:34.708585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 645/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:34.714060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:34.815443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:34.824340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44e9c7-d621-4b20-ad69-a11c6222d63f None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:34.859966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:34.860740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.861076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.861394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] PATH_INFO: `/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/ebc702da0b654042a0f5526ea47ef536/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.863698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] RBAC: Authorizing `identity:create_grant(project_id=b915d9f6e106444188d392ed85ce3f23, user_id=ebc702da0b654042a0f5526ea47ef536, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:34.865274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192d8ac-26c8-4ec8-8dd2-7b77fc58022f None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:35.031242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 628/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Sep 8 13:50:34 2022] PUT /identity/v3/projects/b915d9f6e106444188d392ed85ce3f23/users/ebc702da0b654042a0f5526ea47ef536/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:50:37.282297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084127e-8f7b-48a3-9b08-6c8ee513bcd9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:37.282867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084127e-8f7b-48a3-9b08-6c8ee513bcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:37.282867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084127e-8f7b-48a3-9b08-6c8ee513bcd9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:37.284191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 646/1274] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:37.289536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:37.289943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:37.290090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:37.309178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:37.310375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:37.380585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 629/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:37.649380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084127e-8f7b-48a3-9b08-6c8ee513bcd9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:37.760003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084127e-8f7b-48a3-9b08-6c8ee513bcd9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:37.798686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:37.816790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:37.817452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:37.817713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:37.817990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:37.829300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:50:37.834168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:37.835370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:37.836466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 647/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Sep 8 13:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:37.841483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:37.927848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:37.946581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f39f9-b9f6-4c25-9258-efd06d5150a1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:37.982324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:37.983444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:37.983730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:37.984011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:37.984710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:37.985016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:37.986419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:37.994682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 630/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Sep 8 13:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:38.001395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:38.106967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397458d-7e69-4213-8cb0-72967d5cf4a5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:38.149397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:38.150035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:38.150315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:38.150584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:38.162139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:38.163606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:38.179343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:38.180543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:38.181734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:38.181734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:38.181734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:38.181734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 648/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:38.186846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:38.297511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758cf5c-7a15-43ca-9128-e518b3ca3a46 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:38.332574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:38.333181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:38.333464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:38.333738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:38.334381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:38.334683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:38.336059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:38.348732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 631/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:38.354871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:38.387726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.466098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9288a-4b52-477f-aa12-9c7908a454ab None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:38.502953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:38.503585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:38.503863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:38.504135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:38.511349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:38.512801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:50:38.525225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:38.532223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:38.533738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 649/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:50:38.534501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:38.536445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.638904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a231-40cc-4213-a3d1-0beb533a8ea8 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:38.674763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:38.675430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:38.675757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:38.676079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:38.677050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:38.677398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:38.679074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:38.698020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 632/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Sep 8 13:50:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:50:38.704813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:38.812034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:38.821527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49432-4c7a-4bac-8b08-a6047cfa92dd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:38.855201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:38.855965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:38.856236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:38.856522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:38.931509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:38.933016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.043826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 650/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Sep 8 13:50:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:50:39.051676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:39.109247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:39.115390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:39.154307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82ea0c-c6c2-457d-969b-24da58db2614 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:39.191532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:39.192166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:39.192446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:39.192755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:39.203586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:39.205100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:50:39.220127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:39.221241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:50:39.222157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:50:39.222157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:50:39.222157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:39.222157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 633/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 13:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:39.227405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:39.330427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e939be-b84b-46d6-94b5-fceb7f808175 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:39.367127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:39.367792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:39.367898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:39.368163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:39.368848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:39.369157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:39.370553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.383380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 651/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Sep 8 13:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:39.389401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:39.503688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf9798-1ed9-4df9-9ea6-505ff58d0ab9 None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:39.518520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:39.542686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:39.543449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:39.543736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:39.544010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:39.552710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:39.554161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:50:39.567612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:39.568714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: ERROR keystone.server.flask.application Sep 08 13:50:39.569777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 634/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Sep 8 13:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:39.574724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:39.633305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:39.683415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eead-b596-4e36-bca7-2310f1d0fdc8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:39.717055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:39.718336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:39.718666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:39.718939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:39.719633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:39.719937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:39.721387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319efe6-3c50-4c60-97bd-011bf0abf8a7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.733505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 652/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Sep 8 13:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:39.739766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:39.839768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a63e-2b9f-4f03-884a-94ff4d4f96aa None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:39.874849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:39.875348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:39.875627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:39.875899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:39.876661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] RBAC: Adding query filter params (role.id=7344c45181b34c769b527731ca22627a, scope.project.id=b915d9f6e106444188d392ed85ce3f23, user.id=ebc702da0b654042a0f5526ea47ef536) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:39.876967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:39.878412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1655-46d6-4958-9090-f06b783a2f03 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:39.887200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 635/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Sep 8 13:50:39 2022] GET /identity/v3/role_assignments?user.id=ebc702da0b654042a0f5526ea47ef536&scope.project.id=b915d9f6e106444188d392ed85ce3f23&role.id=7344c45181b34c769b527731ca22627a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:42.154453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23634055-4c94-4772-bec3-75576507626f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:42.156021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23634055-4c94-4772-bec3-75576507626f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:42.156021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23634055-4c94-4772-bec3-75576507626f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:42.156888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 653/1288] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:42.162317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:42.162815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:42.162919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:42.182017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:42.183245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:42.213343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:42.251604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 636/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:50:42.526219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23634055-4c94-4772-bec3-75576507626f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:42.629436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23634055-4c94-4772-bec3-75576507626f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:42.640809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:42.664810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:42.665442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:42.665720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:42.665989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:42.666576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:42.668220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:42.677546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:42.680703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:42.681817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 654/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:50:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:42.684957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:42.793870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a6798-080d-4bf2-aa0f-3c8ddebe447b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:42.833942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:42.834572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:42.834851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:42.835125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:42.835763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:42.836066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:42.837493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba708-aa90-4ee6-8e12-2aaf56a51433 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:42.843811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 637/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Sep 8 13:50:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:42.850265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:42.960303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd3e5-2e4f-4b66-99ca-f94df1ca602b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:42.996148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:42.996800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:42.997080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:42.997358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:42.997991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:42.998316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:43.000063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5354cf1-2633-48dd-9907-0c21be36413d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:43.005148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 655/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Sep 8 13:50:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:45.236794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9069-c743-47f1-8164-f81ab2b2726c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:45.237528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9069-c743-47f1-8164-f81ab2b2726c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:45.237528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9069-c743-47f1-8164-f81ab2b2726c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:45.238676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 638/1293] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:45.244567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512e59-a4ec-40a6-ad5a-d882e8243cc8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:45.245013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512e59-a4ec-40a6-ad5a-d882e8243cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:45.245188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512e59-a4ec-40a6-ad5a-d882e8243cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:45.263946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-10512e59-a4ec-40a6-ad5a-d882e8243cc8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:45.265728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-10512e59-a4ec-40a6-ad5a-d882e8243cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:45.297643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:45.341144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 656/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:45.612229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9069-c743-47f1-8164-f81ab2b2726c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:45.644183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:45.713605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9069-c743-47f1-8164-f81ab2b2726c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:45.746439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:45.747047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:45.747329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:45.747601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:45.748851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:45.750446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ae107-4ea6-4a7e-8713-06bffd7f578d None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:46.081548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 639/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Sep 8 13:50:45 2022] POST /identity/v3/services => generated 246 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:50:48.305984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baa60-3b49-474a-b01c-6f342eafa1ce None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:48.306539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baa60-3b49-474a-b01c-6f342eafa1ce None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:48.306539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baa60-3b49-474a-b01c-6f342eafa1ce None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:48.307854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 657/1296] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:48.313285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:48.313710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:48.313850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:48.332029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:48.333268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:48.424910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 640/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:50:48.699835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805baa60-3b49-474a-b01c-6f342eafa1ce None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:48.806281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805baa60-3b49-474a-b01c-6f342eafa1ce None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:48.841265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:48.843531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:48.843531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:48.843531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:48.843791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:48.845059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:48.853910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:48.855155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:48.856190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 658/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:50:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:48.863622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:48.882659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:48.968868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7ca3c-35c2-44aa-94f7-6ccc5caf4c07 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:49.016488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:49.017141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:49.017423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:49.017696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:49.018338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:49.018643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:49.020012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:49.027795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 641/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Sep 8 13:50:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:49.033955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:49.066640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:49.136395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72714cc7-94c2-4f40-84c1-3906fd322ca6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:49.169618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:49.170774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:49.171059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:49.171360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:49.172100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] RBAC: Adding query filter params (interface=public, service_id=5ad04874905a4a9cb5e8cd29b69134b9, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:49.172405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:49.173800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ebb5-7a58-467d-abf1-075a8a3ddf84 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:49.178865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 659/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Sep 8 13:50:49 2022] GET /identity/v3/endpoints?service_id=5ad04874905a4a9cb5e8cd29b69134b9&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:49.184774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:49.275752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:49.294891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa5b0a-f131-4151-95c7-dab1f8ec0e8b None admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:49.339372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:49.340107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:49.340271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:49.340586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:49.341213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:49.342970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f6e9a-e874-42eb-ac7a-0e6b120aff24 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:49.350752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 642/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Sep 8 13:50:49 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:50:51.588824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154f40-79e4-4e61-9428-a3e46f0f7615 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:51.589448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154f40-79e4-4e61-9428-a3e46f0f7615 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:51.589448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154f40-79e4-4e61-9428-a3e46f0f7615 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:51.590731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 660/1302] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 13:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:51.596252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:51.596700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:51.596849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:51.616030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:51.617255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:51.686156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 643/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 13:50:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:50:51.966012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154f40-79e4-4e61-9428-a3e46f0f7615 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:52.064970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:52.072003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154f40-79e4-4e61-9428-a3e46f0f7615 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:52.107048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:52.108432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:52.108805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:52.109034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:52.109616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:52.110986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:50:52.119910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:50:52.127137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Sep 08 13:50:52.128001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 661/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Sep 8 13:50:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:50:52.129013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:52.204843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:52.227847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523f57-8090-41b1-8f7d-c3ae37483d12 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:52.261389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] PATH_INFO: `/v3/services` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:52.265737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6352f52-62af-46a1-94ba-cb42334bda23 None admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:52.270358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 644/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Sep 8 13:50:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:52.276342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:52.377126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e797412-2a37-49d6-a613-1a92c40f119d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:52.433810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:52.434455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:52.434781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:52.435151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:52.436049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:52.438002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224ff86-562a-4376-971f-ac0118bddbcb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:52.550810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 662/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 13:50:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:51:02.302008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=30 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:02.545074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:40.613134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2c21-3107-465e-8300-f32c5ecd64fc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.613697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2c21-3107-465e-8300-f32c5ecd64fc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.613697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e2c21-3107-465e-8300-f32c5ecd64fc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.615052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 645/1307] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:40.621441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c50d0-f21a-4588-add4-eee57280b75a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.622301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c50d0-f21a-4588-add4-eee57280b75a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.622768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c50d0-f21a-4588-add4-eee57280b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.747751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8d4c50d0-f21a-4588-add4-eee57280b75a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:40.749273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8d4c50d0-f21a-4588-add4-eee57280b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:40.892562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 663/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:41.204358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:41.205159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:41.205736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:41.207742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 646/1309] 10.222.0.33 () {54 vars in 965 bytes} [Thu Sep 8 14:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:41.214785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c179dc-eed1-4608-875a-61139c77be0a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:41.215117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c179dc-eed1-4608-875a-61139c77be0a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:41.215367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c179dc-eed1-4608-875a-61139c77be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:41.307321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f2c179dc-eed1-4608-875a-61139c77be0a None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:41.308840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f2c179dc-eed1-4608-875a-61139c77be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:41.331540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:41.392441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 664/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Thu Sep 8 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:41.401980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:41.404107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:41.548848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2932de-1558-4412-bee0-7be9446df3a1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:41.661339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:41.661977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:41.662217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:41.662415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:41.665446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:41.728329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:41.795846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:41.797622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50580ee3-18cc-4405-88c8-a9c9239c3077 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:41.821332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 647/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:44.414026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:44.414514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:44.414610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:44.415919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 665/1312] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:44.421084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905108ac-90f6-4f8b-b4c6-0c5936ab42db None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:44.421495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905108ac-90f6-4f8b-b4c6-0c5936ab42db None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:44.421628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905108ac-90f6-4f8b-b4c6-0c5936ab42db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:44.491964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-905108ac-90f6-4f8b-b4c6-0c5936ab42db None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:44.493188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-905108ac-90f6-4f8b-b4c6-0c5936ab42db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:44.591211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 648/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:44.880633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:44.882495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:44.989618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61bee8-1904-4aaf-b8e6-d66130d6fd95 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:45.064292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:45.066647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:45.067251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:45.067532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:45.067804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:45.069601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:45.181244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:45.182677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0961a-7757-43c4-958c-c6e42688985c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:45.200632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 666/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:48.028111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.028698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.028698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.030078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 649/1315] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:48.035338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308a5-7ddf-413c-9117-f87c52a884c5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.035737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308a5-7ddf-413c-9117-f87c52a884c5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.035894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308a5-7ddf-413c-9117-f87c52a884c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.102460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d19308a5-7ddf-413c-9117-f87c52a884c5 None None] MFA Rules not processed for user `f3d7167a4d1049d3a536c8bc86d11745`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:48.103791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d19308a5-7ddf-413c-9117-f87c52a884c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:48.156855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:48.209707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 667/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:48.509239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:48.510824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:48.520966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:48.616694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928b88-1fc7-4758-b28c-25b5f84649ab None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:48.690765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:48.691375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.691652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.691925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.693554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:48.759283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:48.807247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:48.808730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a38715-f8b2-47ce-9b1d-2a599a5c929f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:48.827959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 650/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:51.926867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346459b7-51a9-4c59-b24c-0f3b79172db4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.927389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346459b7-51a9-4c59-b24c-0f3b79172db4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.927389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346459b7-51a9-4c59-b24c-0f3b79172db4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.929246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 668/1318] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:51.935593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44cc85-134f-4c9b-a7af-d041de9252b7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.936080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44cc85-134f-4c9b-a7af-d041de9252b7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.936176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44cc85-134f-4c9b-a7af-d041de9252b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:52.002757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8f44cc85-134f-4c9b-a7af-d041de9252b7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:52.003992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8f44cc85-134f-4c9b-a7af-d041de9252b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:52.102189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 651/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:52.412759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:52.413758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:52.414514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:52.415864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 669/1320] 10.222.0.33 () {54 vars in 965 bytes} [Thu Sep 8 14:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:52.421824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8e16-c514-4971-a9c9-044fe1276137 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:52.422120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8e16-c514-4971-a9c9-044fe1276137 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:52.422400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8e16-c514-4971-a9c9-044fe1276137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:52.446014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:52.498950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1bde8e16-c514-4971-a9c9-044fe1276137 None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:52.500148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1bde8e16-c514-4971-a9c9-044fe1276137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:52.574711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 652/1321] 10.222.0.33 () {58 vars in 1062 bytes} [Thu Sep 8 14:00:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:52.583916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:52.624416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:52.697880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0a3cc-775d-4fd4-a94b-1f47447711c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:52.775183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:52.775805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:52.776084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:52.776353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:52.777995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:52.784753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:52.885386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:52.886759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e69200-08c5-4cf4-924d-af42aa4e2244 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:52.905076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 670/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:56.856799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.857397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.857397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.858695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 653/1323] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:00:56.863899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903afe0f-7483-4a30-900c-7efdaaf11db1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.864324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903afe0f-7483-4a30-900c-7efdaaf11db1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.864642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903afe0f-7483-4a30-900c-7efdaaf11db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.940610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-903afe0f-7483-4a30-900c-7efdaaf11db1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:56.941871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-903afe0f-7483-4a30-900c-7efdaaf11db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:57.008386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:57.047347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 671/1324] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:57.334492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:57.336930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:57.450288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab241bb-f0a5-491f-a476-6b305a6ccd5d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:57.463993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:57.527849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:57.528462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:57.528771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:57.529047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:57.530640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:57.653824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:57.655273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73742630-a8d1-45f7-83cf-da55555d859f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:57.673940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 654/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:00.004966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:00.005490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:00.005613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:00.006920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 672/1326] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:00.012364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62b13-42e0-4068-9334-fa102fd6aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:00.012829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62b13-42e0-4068-9334-fa102fd6aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:00.012958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab62b13-42e0-4068-9334-fa102fd6aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:00.063861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:00.082253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3ab62b13-42e0-4068-9334-fa102fd6aaa7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:00.083519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3ab62b13-42e0-4068-9334-fa102fd6aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:00.188942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 655/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:00.495567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:00.497137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:00.606990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396a570-b8e3-4950-9ed7-d3b7c31ceec4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:00.684625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:00.685177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:00.685460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:00.685734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:00.687342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:00.705275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:00.803494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:00.805747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415e4ae-ae63-40d4-bc46-11fd06ace0ab service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:00.824057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 673/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:03.064679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.064679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.064679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.064679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 656/1329] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:03.071112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4408d-1c99-4be8-ac2d-4b9130d7cc41 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.071548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4408d-1c99-4be8-ac2d-4b9130d7cc41 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.072104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4408d-1c99-4be8-ac2d-4b9130d7cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.150585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-05e4408d-1c99-4be8-ac2d-4b9130d7cc41 None None] MFA Rules not processed for user `f3d7167a4d1049d3a536c8bc86d11745`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:03.152033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-05e4408d-1c99-4be8-ac2d-4b9130d7cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.222693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:03.253891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 674/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:03.542131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.543678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.653288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0cd07-f9e4-4c91-8ac1-84af666f6726 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.676351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:03.733904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.734514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.734792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.735061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.736823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.856203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.857703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7251e9-3204-4256-ae5d-4ba7c4df5223 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.877884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 657/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:06.644138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:06.644689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:06.644689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:06.645990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 675/1332] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:06.651779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05566aa-d6eb-4268-be6d-10ac6d0d3cb4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:06.652371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05566aa-d6eb-4268-be6d-10ac6d0d3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:06.652608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05566aa-d6eb-4268-be6d-10ac6d0d3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:06.716754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:06.719575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f05566aa-d6eb-4268-be6d-10ac6d0d3cb4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:06.720846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f05566aa-d6eb-4268-be6d-10ac6d0d3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:06.819595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 658/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:07.127649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:07.129368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:07.234148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240d6df-2512-412d-a296-a60c42ea4154 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:07.311724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:07.312330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:07.312646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:07.312917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:07.314812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:07.344328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:07.434961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:07.436595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a923a7-a28b-43cd-ae36-66fc11063ab6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:07.455094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 676/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:09.882056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:09.882775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:09.882775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:09.884195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 659/1335] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:09.889897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878d75-e3c5-4516-92a2-577ff23b93ac None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:09.892002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878d75-e3c5-4516-92a2-577ff23b93ac None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:09.892002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37878d75-e3c5-4516-92a2-577ff23b93ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:09.959894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-37878d75-e3c5-4516-92a2-577ff23b93ac None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:09.961294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-37878d75-e3c5-4516-92a2-577ff23b93ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:10.042922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:10.065456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 677/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:10.363501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:10.365075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:10.472071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9d0e-c0d4-4a32-8bee-2b7b1542a422 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:10.507545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:10.557441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:10.558058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:10.558336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:10.558606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:10.560265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:10.673856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:10.675209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976f7b4-2a22-4ded-a6bc-ca9e1d24d034 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:10.693737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 660/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:14.046580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:14.047154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:14.047154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:14.048556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 678/1338] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:14.054223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1d73-ca48-4793-b819-5918ffc6b570 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:14.054648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1d73-ca48-4793-b819-5918ffc6b570 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:14.054900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1d73-ca48-4793-b819-5918ffc6b570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:14.122701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1e3d1d73-ca48-4793-b819-5918ffc6b570 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:14.123922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1e3d1d73-ca48-4793-b819-5918ffc6b570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:14.132294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:14.222925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 661/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:14.516032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:14.517612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:14.642470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6cc39-c75e-4a73-b7a0-cf3105bc96bd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:14.723281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:14.723898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:14.724182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:14.724457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:14.726542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:14.771787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:14.857618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:14.859067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c957eca-5608-4992-be0b-3f8d841b5de6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:14.878423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 679/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:19.588931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:19.589482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:19.589482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:19.590837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 662/1341] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:19.596423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8da22-f32d-467c-a89c-76f120a5125f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:19.596924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8da22-f32d-467c-a89c-76f120a5125f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:19.597173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8da22-f32d-467c-a89c-76f120a5125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:19.666511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-daf8da22-f32d-467c-a89c-76f120a5125f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:19.667711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-daf8da22-f32d-467c-a89c-76f120a5125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:19.759103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:19.769814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 680/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:20.051554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:20.054029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:20.162252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d9847-e78e-4505-8d09-d2c62c6a0e62 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:20.203053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:20.240203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:20.241664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:20.242218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:20.242581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:20.244200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:20.360742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:20.362255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133a1df-8ac7-48bb-9fea-7ec8c1fb91c8 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:20.382901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 663/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:23.784282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:23.784867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:23.784977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:23.786285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 681/1344] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:23.792594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2d7ab-d607-4f2a-b0df-e7ebe358dd3d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:23.793024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2d7ab-d607-4f2a-b0df-e7ebe358dd3d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:23.793206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2d7ab-d607-4f2a-b0df-e7ebe358dd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:23.861374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3cb2d7ab-d607-4f2a-b0df-e7ebe358dd3d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:23.862522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3cb2d7ab-d607-4f2a-b0df-e7ebe358dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:23.881657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:23.965409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 664/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:24.252006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:24.253574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:24.363003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7187f50-ab23-4191-94cd-5b2d1f101806 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:24.475373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:24.475916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:24.476201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:24.476471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:24.478141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:24.533774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:24.614466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:24.616026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fea55-ac23-4541-8eca-15dd1d1acc73 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:24.638969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 682/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:29.272948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:29.273490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:29.273615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:29.275013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 665/1347] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:29.280790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d736-c8ca-4998-9b55-1d0c0717e18b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:29.281296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d736-c8ca-4998-9b55-1d0c0717e18b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:29.281402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d736-c8ca-4998-9b55-1d0c0717e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:29.354956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5772d736-c8ca-4998-9b55-1d0c0717e18b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:29.356205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5772d736-c8ca-4998-9b55-1d0c0717e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:29.464254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:29.466817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 683/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:29.760288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:29.761900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:29.870277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb90c2-3827-403f-8b98-22a841112068 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:29.917959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:29.945293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:29.945906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:29.946219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:29.946497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:29.948114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:30.062050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:30.063556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054c1b0-226a-4e62-9f9f-f8f641c2196f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:30.082052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 666/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:35.164564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020665be-22a7-4a8d-a921-3df9d51d7ab2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:35.165156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020665be-22a7-4a8d-a921-3df9d51d7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:35.165602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020665be-22a7-4a8d-a921-3df9d51d7ab2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:35.168282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 684/1350] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:01:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:35.175874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d14ae-ae85-4613-ad91-c70ec6f7c1b9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:35.176318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d14ae-ae85-4613-ad91-c70ec6f7c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:35.176465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d14ae-ae85-4613-ad91-c70ec6f7c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:35.286484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-482d14ae-ae85-4613-ad91-c70ec6f7c1b9 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:35.289088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-482d14ae-ae85-4613-ad91-c70ec6f7c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:35.315590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:35.495881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 667/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:39.701491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aec94-b22d-4689-aba3-54160c82fafc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.702096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aec94-b22d-4689-aba3-54160c82fafc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.702318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aec94-b22d-4689-aba3-54160c82fafc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.704031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 685/1352] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:39.709383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449923-5dbd-44ff-b115-99c5817e2f02 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.710200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449923-5dbd-44ff-b115-99c5817e2f02 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.710484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e449923-5dbd-44ff-b115-99c5817e2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.797758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3e449923-5dbd-44ff-b115-99c5817e2f02 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:39.799116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3e449923-5dbd-44ff-b115-99c5817e2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:39.882874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:39.920549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 668/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:41.779466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ae46-b9c2-4389-ad7b-f3af6f253715 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:41.780057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ae46-b9c2-4389-ad7b-f3af6f253715 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:41.780426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23ae46-b9c2-4389-ad7b-f3af6f253715 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:41.782688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 686/1354] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:01:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:41.791047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972d7b-f202-4757-9f0b-0ec50cbf861e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:41.791585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972d7b-f202-4757-9f0b-0ec50cbf861e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:41.791585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1972d7b-f202-4757-9f0b-0ec50cbf861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:41.901969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b1972d7b-f202-4757-9f0b-0ec50cbf861e None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:41.903187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b1972d7b-f202-4757-9f0b-0ec50cbf861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:42.017750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 669/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:45.759929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72112c1-83ce-4e7f-a7ad-cf8e69b34c56 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:45.760948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72112c1-83ce-4e7f-a7ad-cf8e69b34c56 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:45.761482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72112c1-83ce-4e7f-a7ad-cf8e69b34c56 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:45.763047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 687/1356] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:45.769006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c3ec-5570-497b-9073-128bcd41b1bc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:45.769512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c3ec-5570-497b-9073-128bcd41b1bc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:45.769607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c3ec-5570-497b-9073-128bcd41b1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:45.815072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:45.862623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c817c3ec-5570-497b-9073-128bcd41b1bc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:45.863853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c817c3ec-5570-497b-9073-128bcd41b1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:45.994390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 670/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:46.296948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:46.297813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:46.298598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:46.302303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 688/1358] 10.222.0.33 () {54 vars in 962 bytes} [Thu Sep 8 14:01:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:46.311616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840654-b292-4fca-9f83-bb5235ada9e8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:46.311903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840654-b292-4fca-9f83-bb5235ada9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:46.312185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840654-b292-4fca-9f83-bb5235ada9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:46.394688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3c840654-b292-4fca-9f83-bb5235ada9e8 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:46.397528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3c840654-b292-4fca-9f83-bb5235ada9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:46.452045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:46.525002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 671/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Sep 8 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:46.534013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:46.535520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:46.712347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864d235-0fc1-4c78-afd6-7c3116ab6ef9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:46.795158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:46.838817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:46.839621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:46.839907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:46.840241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:46.841889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:46.949739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:46.951469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0a10-5da0-408d-8dfa-d36fa2cd24c0 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:46.976405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 689/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:49.467816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:49.468432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:49.468432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:49.469920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 672/1361] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:49.476099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca726-13c4-4f54-80d8-a73ffc94f864 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:49.477079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca726-13c4-4f54-80d8-a73ffc94f864 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:49.477564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca726-13c4-4f54-80d8-a73ffc94f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:49.558984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e10ca726-13c4-4f54-80d8-a73ffc94f864 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:49.560672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e10ca726-13c4-4f54-80d8-a73ffc94f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:49.613984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:49.679756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 690/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:49.975885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:49.977907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:50.165254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4150f-2dd2-4de5-9e9d-e37c55b1f107 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:50.178291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:50.322887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:50.323363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:50.323646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:50.323925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:50.325775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:50.444955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:50.446479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505fb76-e887-445a-ae83-90ec0c8c0729 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:50.467255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 673/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:53.319340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c114eb-8d18-4618-af8a-b4c27a08e19c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:53.320134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c114eb-8d18-4618-af8a-b4c27a08e19c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:53.320134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c114eb-8d18-4618-af8a-b4c27a08e19c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:53.321649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 691/1364] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:01:53.327197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109876c-73b1-46d8-80c0-ec912361348e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:53.327726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109876c-73b1-46d8-80c0-ec912361348e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:53.327726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109876c-73b1-46d8-80c0-ec912361348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:53.345596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:53.406585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f109876c-73b1-46d8-80c0-ec912361348e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:53.407859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f109876c-73b1-46d8-80c0-ec912361348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:53.531096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 674/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:53.826927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:53.827486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:53.828130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:53.830575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 692/1366] 10.222.0.33 () {54 vars in 962 bytes} [Thu Sep 8 14:01:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:53.837977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1561c-d041-4296-b2f3-78e9820b6385 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:53.841405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1561c-d041-4296-b2f3-78e9820b6385 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:53.841405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1561c-d041-4296-b2f3-78e9820b6385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:53.964692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-53b1561c-d041-4296-b2f3-78e9820b6385 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:53.964692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-53b1561c-d041-4296-b2f3-78e9820b6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.023753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:54.123500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 675/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Sep 8 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:54.132427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:54.135844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.339772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9f3e-bd69-4c0f-90da-4f0d50f87010 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:54.365000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e38e-76b7-4e82-8d2c-eaa5e6c02c64 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e38e-76b7-4e82-8d2c-eaa5e6c02c64 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e38e-76b7-4e82-8d2c-eaa5e6c02c64 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 676/1368] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e406ba-387c-4a94-8fd5-f6ba2a9d1aee None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.411862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e406ba-387c-4a94-8fd5-f6ba2a9d1aee None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.413418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e406ba-387c-4a94-8fd5-f6ba2a9d1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.492762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c2e406ba-387c-4a94-8fd5-f6ba2a9d1aee None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:54.494379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c2e406ba-387c-4a94-8fd5-f6ba2a9d1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.533043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:54.534106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.535112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.535878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.539048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.667058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:54.680200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 677/1369] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:54.708497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:54.711190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec04fa-f4d3-4d3a-af2f-a4e05f3ff589 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:54.754141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 693/1370] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:55.060270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:55.060585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:55.060868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:55.062250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 678/1371] 10.222.0.33 () {54 vars in 964 bytes} [Thu Sep 8 14:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:55.067767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78150-0d62-4ef5-a4ee-f7d2ade5192f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:55.068056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78150-0d62-4ef5-a4ee-f7d2ade5192f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:55.068355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b78150-0d62-4ef5-a4ee-f7d2ade5192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:55.102900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:55.177565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-59b78150-0d62-4ef5-a4ee-f7d2ade5192f None None] MFA Rules not processed for user `f9cdf8633c7740629b6956f631959f04`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:55.179837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59b78150-0d62-4ef5-a4ee-f7d2ade5192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:55.290351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 694/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Sep 8 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:55.302153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:55.304234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:55.435858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e11d64-3092-46c1-a9b5-b87a1c0e9a52 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:55.530637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:55.531380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:55.531796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:55.532190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:55.534155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:55.592968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:55.664349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:55.665611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96530-b5fa-4dea-9a94-b8d1f33e88eb service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:55.687512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 679/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:57.380203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:57.380842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:57.380842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:57.382963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 695/1374] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:57.388452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893659a8-d1c5-4a5d-95d1-63da35860d23 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:57.388953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893659a8-d1c5-4a5d-95d1-63da35860d23 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:57.389072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893659a8-d1c5-4a5d-95d1-63da35860d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:57.470278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-893659a8-d1c5-4a5d-95d1-63da35860d23 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:57.471536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-893659a8-d1c5-4a5d-95d1-63da35860d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:57.593337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 680/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:57.919809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:57.921784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:58.091870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:58.134603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dad32-2f62-461e-9b6d-0b3ce1c545e5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:58.302723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:58.304760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:58.304760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:58.305538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:58.307774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:58.435066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:58.454407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:58.456049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74279211-367b-4dc2-955e-e1558164cabe service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:58.481642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 696/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:01.075936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:01.076719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:01.076719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:01.078021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 681/1377] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:01.083478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5148-c35e-4241-924c-a8a2a6482910 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:01.084840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5148-c35e-4241-924c-a8a2a6482910 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:01.084840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5148-c35e-4241-924c-a8a2a6482910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:01.165552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-df0c5148-c35e-4241-924c-a8a2a6482910 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:01.165552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-df0c5148-c35e-4241-924c-a8a2a6482910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:01.332561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 697/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:01.656214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:01.658183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:01.661327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:01.856591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ef344-d4eb-4d3a-86a9-f5af8a9f386b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:02.002560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:02.076961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:02.078041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:02.078483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:02.078909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:02.081601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:02.235031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:02.236984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418fc4f-dd39-44ad-8690-1958a3e0cc92 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:02.260275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 682/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:04.863200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:04.863894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:04.863894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:04.865131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 698/1380] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:04.871414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330d30b-3c08-48fe-92aa-a0d5391cee18 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:04.872031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330d30b-3c08-48fe-92aa-a0d5391cee18 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:04.872031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330d30b-3c08-48fe-92aa-a0d5391cee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:04.946927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b330d30b-3c08-48fe-92aa-a0d5391cee18 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:04.948206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b330d30b-3c08-48fe-92aa-a0d5391cee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:04.989884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:05.049752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 683/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:05.376186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:05.377837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:05.445531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:05.543429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aba4f3-9c0a-4bbc-9d0a-328989843030 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:05.696633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:05.698085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:05.698380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:05.698708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:05.700454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:05.725584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:05.833250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:05.835524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c5399-159e-4f13-97b1-ebaa42da84dd service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:05.856375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 699/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:08.496110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:08.496973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:08.496973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:08.498092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 684/1383] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:08.504660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21647-c9a2-45e2-b1db-4a7a78ff577c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:08.505464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21647-c9a2-45e2-b1db-4a7a78ff577c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:08.505464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21647-c9a2-45e2-b1db-4a7a78ff577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:08.606717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-13e21647-c9a2-45e2-b1db-4a7a78ff577c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:08.608380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-13e21647-c9a2-45e2-b1db-4a7a78ff577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:08.783347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:08.794849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 700/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:09.095420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:09.097536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:09.338818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b6149-353c-4777-8452-f73d74c1f110 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:09.369472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:09.485817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:09.486439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:09.486721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:09.486996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:09.488674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:09.614881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:09.616670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e1add-bc33-4cce-9bc0-d2001d6fcafb service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:09.637147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 685/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:11.929859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81555-461a-450c-a3a5-a6b26eba0d01 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:11.930461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81555-461a-450c-a3a5-a6b26eba0d01 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:11.930461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa81555-461a-450c-a3a5-a6b26eba0d01 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:11.931780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 701/1386] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:02:11.937666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:11.938260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:11.938260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:11.982734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:12.023905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:12.025344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:12.105025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fe33-c046-4a5b-9f51-78ed0590c29f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.105308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fe33-c046-4a5b-9f51-78ed0590c29f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.105628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97fe33-c046-4a5b-9f51-78ed0590c29f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.107075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 702/1387] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:02:12.112759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592fe9-f6fd-4b30-8605-b91930dfd86c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.113044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592fe9-f6fd-4b30-8605-b91930dfd86c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.113320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01592fe9-f6fd-4b30-8605-b91930dfd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.147660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 686/1388] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:12.188170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-01592fe9-f6fd-4b30-8605-b91930dfd86c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:12.189274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-01592fe9-f6fd-4b30-8605-b91930dfd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:12.295907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 703/1389] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:02:12.462288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:12.463508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:12.586554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:12.595317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae135eb-07f0-44be-9ff2-c23d90c2ea7d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:12.606099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c5d2-0a24-4f5f-91a9-a5a07b69806d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.606390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c5d2-0a24-4f5f-91a9-a5a07b69806d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.606676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c5d2-0a24-4f5f-91a9-a5a07b69806d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.608092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 704/1390] 10.222.0.33 () {54 vars in 961 bytes} [Thu Sep 8 14:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:02:12.614199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.614718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.615446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.712671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] MFA Rules not processed for user `5b1ae9fed0454cb390554e3ad0ef580e`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:12.713863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:12.732909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:12.754751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:12.755378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.755717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.756318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.757889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:12.798808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 705/1391] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Sep 8 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:02:12.810774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:12.820937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6d4c7-2634-4524-874b-6313529d371c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:12.862968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:12.864603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca679833-2db8-44c5-b84d-9ca0d4ac940a service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:12.881160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:12.885001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 687/1392] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:12.909173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:12.911906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:12.911906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:12.911906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:12.911906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:13.003752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:13.039536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:13.041193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248cee8-9ec5-4b48-ba5e-b7ca441b11b6 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:13.063016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 706/1393] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:02:14.124131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0386c-bf17-4917-b35e-6b76322bf6d1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:14.124716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0386c-bf17-4917-b35e-6b76322bf6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:14.124716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0386c-bf17-4917-b35e-6b76322bf6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:14.202124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9ed0386c-bf17-4917-b35e-6b76322bf6d1 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:14.203329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9ed0386c-bf17-4917-b35e-6b76322bf6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:14.312054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 688/1394] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:02:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:14.365075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:14.366728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:14.366728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:14.367843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 707/1395] 10.222.0.33 () {54 vars in 943 bytes} [Thu Sep 8 14:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:14.374423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869e51-6098-4fdf-b152-2952b2170e4b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:14.374787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869e51-6098-4fdf-b152-2952b2170e4b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:14.375139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869e51-6098-4fdf-b152-2952b2170e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:14.464075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d4869e51-6098-4fdf-b152-2952b2170e4b None None] MFA Rules not processed for user `b60fd9fbd81e403e8b22b8204eb92dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:14.465254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d4869e51-6098-4fdf-b152-2952b2170e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:14.501716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:14.588272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 689/1396] 10.222.0.33 () {58 vars in 1040 bytes} [Thu Sep 8 14:02:14 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:14.600912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:14.602666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:14.775582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d35cb1-c62b-467d-90b7-368e405593f7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:14.853536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:14.918015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:14.918667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:14.918937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:14.919210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:14.921108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:15.020403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:15.022816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96acd-2f3e-4852-80c4-94163bca3c5e service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:15.031971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 708/1397] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:02:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:02:15.449044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:15.449703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:15.449703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:15.450876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 690/1398] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:02:15.456149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610eab-9c1b-4f98-b9b2-3fcc820b04ba None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:15.456604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610eab-9c1b-4f98-b9b2-3fcc820b04ba None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:15.456732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9610eab-9c1b-4f98-b9b2-3fcc820b04ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:15.530473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f9610eab-9c1b-4f98-b9b2-3fcc820b04ba None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:15.531716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f9610eab-9c1b-4f98-b9b2-3fcc820b04ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:15.575877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:15.632610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 709/1399] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:15.925656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:15.927229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:16.093233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455380-e88b-48d4-bf27-bc9f204c53c5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:16.097502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:16.232052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:16.232716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:16.236549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:16.236549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:16.236549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:16.364911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:16.367534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50fa6-3633-4fe3-87cd-682fe72389f0 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:16.391679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 691/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:18.952455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:18.953060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:18.953060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:18.954779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 710/1401] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:02:18.960417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba86c-d0a5-41c7-8ac3-c947f897dc7d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:18.960971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba86c-d0a5-41c7-8ac3-c947f897dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:18.961067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ba86c-d0a5-41c7-8ac3-c947f897dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:18.973448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:19.040819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-700ba86c-d0a5-41c7-8ac3-c947f897dc7d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:19.042059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-700ba86c-d0a5-41c7-8ac3-c947f897dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:19.159934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 692/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:19.463182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:19.464837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:19.643592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a333a-edd1-445c-8cc1-e092c7d1a544 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:19.676829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:19.796624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:19.797239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:19.797521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:19.797794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:19.799425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:19.903826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:19.905568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b50af-ba17-4477-8c27-39a71d4b1965 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:19.929830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 711/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:22.466488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:22.467408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:22.468150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:22.470023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 693/1404] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:22.475647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa8cd-c585-4d97-8c01-4eef42ec8576 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:22.476643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa8cd-c585-4d97-8c01-4eef42ec8576 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:22.476926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfa8cd-c585-4d97-8c01-4eef42ec8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:22.524070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:22.562775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-98dfa8cd-c585-4d97-8c01-4eef42ec8576 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:22.564051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98dfa8cd-c585-4d97-8c01-4eef42ec8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:22.708707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 712/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:22.988869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:22.992108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:23.106571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:23.185075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82412b19-9226-4560-ad4b-14d0335a5226 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:23.327186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:23.328183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:23.328602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:23.328877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:23.330809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:23.395018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:23.444263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:23.445921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73f8c-b5d5-4412-90f4-c1a8038add46 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:23.469707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 694/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:26.175427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:26.175958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:26.175958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:26.181637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 713/1407] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:02:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:26.183530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7b3c-8c02-4ed8-849d-323c2826eb49 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:26.183991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7b3c-8c02-4ed8-849d-323c2826eb49 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:26.184097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f7b3c-8c02-4ed8-849d-323c2826eb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:26.264879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ca1f7b3c-8c02-4ed8-849d-323c2826eb49 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:26.266112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ca1f7b3c-8c02-4ed8-849d-323c2826eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:26.392791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 695/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:02:26.696623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:26.698580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:26.882538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:26.941608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3c8c6-6be3-4bb8-969a-086acf4e8c31 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:27.102157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:27.102782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:27.103071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:27.103351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:27.105068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:27.197609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:27.221443 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:27.223076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93027-139e-482a-b107-a48ea6855598 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:27.249870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 714/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:36.390897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:37.247898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=14 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:41.404453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db906-eeb1-4579-ae79-e9d811932e9c None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:41.405131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db906-eeb1-4579-ae79-e9d811932e9c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:41.405131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db906-eeb1-4579-ae79-e9d811932e9c None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:41.406517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 696/1410] 10.222.0.33 () {54 vars in 918 bytes} [Thu Sep 8 14:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:41.414152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f604f-639a-49db-8c43-ee1400f0358b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:41.414744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f604f-639a-49db-8c43-ee1400f0358b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:41.414883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f604f-639a-49db-8c43-ee1400f0358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:41.516107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-113f604f-639a-49db-8c43-ee1400f0358b None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:41.517390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-113f604f-639a-49db-8c43-ee1400f0358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:41.636324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 715/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Sep 8 14:02:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:41.652266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6182e7-8853-4561-bdae-c6a7670c2891 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:41.652583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6182e7-8853-4561-bdae-c6a7670c2891 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:41.652870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6182e7-8853-4561-bdae-c6a7670c2891 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:41.654257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 697/1412] 10.222.0.33 () {54 vars in 918 bytes} [Thu Sep 8 14:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:41.659568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511824-3f79-482b-90a6-27f897802ea0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:41.659796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511824-3f79-482b-90a6-27f897802ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:41.660075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511824-3f79-482b-90a6-27f897802ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:41.745041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:41.748075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-89511824-3f79-482b-90a6-27f897802ea0 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:41.749365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-89511824-3f79-482b-90a6-27f897802ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:41.897740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 716/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Sep 8 14:02:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:44.714504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:44.715046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:44.715046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:44.716329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:44.721818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dc07-8e7a-483d-9d5e-d367e440af0f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:44.722268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dc07-8e7a-483d-9d5e-d367e440af0f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:44.722379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1dc07-8e7a-483d-9d5e-d367e440af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:44.792902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6ac1dc07-8e7a-483d-9d5e-d367e440af0f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:44.794140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6ac1dc07-8e7a-483d-9d5e-d367e440af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:44.852037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:44.896364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:02:45.195372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:45.196940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:45.354501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34d3eb-4d1f-459e-ab6e-21bbf7ce8b30 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:45.430949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:45.471821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:45.472427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:45.472737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:45.473014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:45.476272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:45.576749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:45.578368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df0032-8902-4b41-83cd-bde809992a7d service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:45.598245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 699/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:46.865249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:46.865834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:46.865953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:46.867237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:46.874128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dea-e18c-41fa-9eaf-3d8d4e085f68 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:46.874940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dea-e18c-41fa-9eaf-3d8d4e085f68 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:46.874940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22092dea-e18c-41fa-9eaf-3d8d4e085f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:46.968600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-22092dea-e18c-41fa-9eaf-3d8d4e085f68 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:46.969400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-22092dea-e18c-41fa-9eaf-3d8d4e085f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:47.001407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:47.080900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:47.236680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:47.238217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:47.392028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9d50-c5c3-4e6e-a3fb-b3556139a5fc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:47.436939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:47.516727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:47.517257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:47.517538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:47.517805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:47.519401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:47.613817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:47.616105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d5e31-1f77-472b-bf83-8a64aff1ac1e service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:47.638249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 719/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:48.809239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:48.809828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:48.809828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:48.811140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:48.817958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910a6e-069a-4a4b-9714-99232155a09d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:48.819106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910a6e-069a-4a4b-9714-99232155a09d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:48.819296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7910a6e-069a-4a4b-9714-99232155a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:48.875907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:48.899548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c7910a6e-069a-4a4b-9714-99232155a09d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:48.900810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c7910a6e-069a-4a4b-9714-99232155a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:49.008773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:49.165489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:49.166957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:49.320083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa428c-cbb9-4883-8311-99059eb1600a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:49.333970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:49.469378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:49.469900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:49.470179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:49.470451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:49.472086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:49.571795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:49.573439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ab35a-7701-4fcb-9352-e4e3e7d082ab service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:49.593447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 702/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:50.775055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:50.775620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:50.775620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:50.777011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:50.784067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef4a7-4066-4c62-96b1-12fe7d64e19f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:50.784697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef4a7-4066-4c62-96b1-12fe7d64e19f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:50.784697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef4a7-4066-4c62-96b1-12fe7d64e19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:50.807457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:50.872672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-cd6ef4a7-4066-4c62-96b1-12fe7d64e19f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:50.873900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cd6ef4a7-4066-4c62-96b1-12fe7d64e19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:50.973601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:51.123988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:51.125774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:51.243072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:51.279416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d17a6-8155-4d02-baf8-324d5ba1fdec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:51.393045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:51.393575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:51.393855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:51.394126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:51.395728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:51.598779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:51.614923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:51.616669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02b0bb-abf0-4c0d-82f7-830ee48ff798 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:51.636703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 722/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:52.785041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:52.785569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:52.785569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:52.787558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:52.794093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914612-ae8e-46f9-b86b-0230bb699946 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:52.794686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914612-ae8e-46f9-b86b-0230bb699946 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:52.794686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf914612-ae8e-46f9-b86b-0230bb699946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:52.878461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cf914612-ae8e-46f9-b86b-0230bb699946 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:52.879669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cf914612-ae8e-46f9-b86b-0230bb699946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:52.982483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:53.138399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:53.139945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:53.225441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:53.289743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1b6c-93f3-4dd3-aadc-8dcc758306f0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:53.407136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:53.407758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:53.408033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:53.408309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:53.409973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:53.463164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:53.509095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:53.510743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082617a5-56f8-4166-9aee-7dc9229e8936 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:53.529906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 705/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:54.743401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:54.744272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:54.744272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:54.745442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:54.752394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f4ad-0c23-40fb-a195-d7e381f0605c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:54.752980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f4ad-0c23-40fb-a195-d7e381f0605c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:54.752980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12f4ad-0c23-40fb-a195-d7e381f0605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:54.832228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fd12f4ad-0c23-40fb-a195-d7e381f0605c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:54.833461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fd12f4ad-0c23-40fb-a195-d7e381f0605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:54.931204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:55.087614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:55.089133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:55.151259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:55.272952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d7c06-c183-497a-9b99-5d0971d62cf9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:55.402604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:55.403114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:55.403392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:55.403658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:55.405307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:55.412992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:55.501512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:55.503228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40233db-a9e2-438e-a33a-3cb13ed272e8 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:55.524641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 725/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:56.699838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:56.700361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:56.700361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:56.701685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:56.708429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923a02-4c01-43db-ae5b-eb9c89575595 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:56.709142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923a02-4c01-43db-ae5b-eb9c89575595 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:56.709285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923a02-4c01-43db-ae5b-eb9c89575595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:56.791998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-33923a02-4c01-43db-ae5b-eb9c89575595 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:56.793255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-33923a02-4c01-43db-ae5b-eb9c89575595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:56.869011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:56.899341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:57.053119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:57.054646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:57.072908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:57.221519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26079e2f-2e0c-4e79-8017-d518dfab49f2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:57.320297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:57.346830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:57.347453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:57.347740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:57.348016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:57.350356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:57.452302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:57.453956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212adcb5-b615-4bf6-8c49-f441387ca8d3 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:57.472916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 708/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:58.666367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:58.667124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:58.667124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:58.668371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:02:58.675842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1f506-9b80-45f9-80cb-92073bc343af None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:58.676401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1f506-9b80-45f9-80cb-92073bc343af None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:58.676401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1f506-9b80-45f9-80cb-92073bc343af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:58.770584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-84c1f506-9b80-45f9-80cb-92073bc343af None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:02:58.772698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-84c1f506-9b80-45f9-80cb-92073bc343af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:58.819876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:58.894281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:02:59.046981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:59.048539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:59.207081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb66fd-9d2a-4468-a3ec-b21f6e5cfe15 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:59.265064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:59.331636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:59.332248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:59.332638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:59.332850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:59.334448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:59.426946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:59.429174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a84d78-b329-4a66-805b-0355f2322dae service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:59.448062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 728/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:00.625504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:00.626357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:00.626560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:00.627983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:00.635639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0143-1582-4bcc-af95-7c4460262ee9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:00.636141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0143-1582-4bcc-af95-7c4460262ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:00.636264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0143-1582-4bcc-af95-7c4460262ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:00.716618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3a4b0143-1582-4bcc-af95-7c4460262ee9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:00.717756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3a4b0143-1582-4bcc-af95-7c4460262ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:00.720160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:00.830881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:00.985306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:00.986855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:01.144397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683c420-c152-4ada-ae0c-57bbf682c553 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:01.172931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:01.265253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:01.265868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:01.266148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:01.266425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:01.268059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:01.493630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:01.495461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d508f-8d72-40d5-ae82-cd095b830dea service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:01.515642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 711/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:03.738956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:03.739511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:03.739511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:03.741240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:03:03.747652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69504a2-62ab-42a3-bfd4-ecd5d1138bc3 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:03.748171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69504a2-62ab-42a3-bfd4-ecd5d1138bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:03.748284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69504a2-62ab-42a3-bfd4-ecd5d1138bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:03.791118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:03.819955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a69504a2-62ab-42a3-bfd4-ecd5d1138bc3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:03.821227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a69504a2-62ab-42a3-bfd4-ecd5d1138bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:03.920807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:04.247864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:04.249582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:04.369444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b2d5d-fff8-4aa6-aa9d-027f4101f1e0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:04.407086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:04.456070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:04.456789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:04.457067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:04.457336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:04.460069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:04.609207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:04.610558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374fc92-504c-481b-8263-686fb8951732 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:04.631963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 731/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:07.172036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:07.172674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:07.172674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:07.173956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:07.180026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de9ef-4831-4b4d-83cb-3f52cd01f5dc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:07.180815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de9ef-4831-4b4d-83cb-3f52cd01f5dc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:07.180815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42de9ef-4831-4b4d-83cb-3f52cd01f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:07.260483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f42de9ef-4831-4b4d-83cb-3f52cd01f5dc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:07.261755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f42de9ef-4831-4b4d-83cb-3f52cd01f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:07.275204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:07.372178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:07.700014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:07.700014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:07.844080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ea9b-ad5a-45cc-a826-07efa28c97ce None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:07.862160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:07.947901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:07.948542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:07.948833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:07.949108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:07.950897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:08.093972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:08.095468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b5d2-8ae3-4791-addf-da70c0a8b916 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:08.118301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 714/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:10.776793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:10.777368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:10.777368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:10.778737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:10.784214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e9a05-ada8-4086-9427-58c5da6e6bcd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:10.784725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e9a05-ada8-4086-9427-58c5da6e6bcd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:10.784832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e9a05-ada8-4086-9427-58c5da6e6bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:10.832886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:10.852413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ee4e9a05-ada8-4086-9427-58c5da6e6bcd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:10.853752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee4e9a05-ada8-4086-9427-58c5da6e6bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:10.955233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:11.256337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:11.258405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:11.378735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586e112-0dfe-4cc6-84ce-a6dc48f55b56 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:11.420627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.456410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:11.457171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:11.457336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:11.457604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:11.459358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:11.573096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:11.574444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529f58a-b817-45de-9246-cffe49cf70d4 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:11.593145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 734/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:13.990320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:13.990884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:13.990884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:13.992212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:13.997692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fead4-4a11-4136-bf7c-23f7418e97b1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:13.998142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fead4-4a11-4136-bf7c-23f7418e97b1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:13.998253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fead4-4a11-4136-bf7c-23f7418e97b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:14.065753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f49fead4-4a11-4136-bf7c-23f7418e97b1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:14.066967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f49fead4-4a11-4136-bf7c-23f7418e97b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:14.088443 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:14.168409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:14.470507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:14.472080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:14.580049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bbb3b-4e68-4b1d-8cb8-f87a3f4d5e87 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:14.602594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:14.659593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:14.660202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:14.660484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:14.660797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:14.663033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:14.778978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:14.780426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59a271-fc1a-4999-b8ed-acd3b23c2077 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:14.799578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 717/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:17.227078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:17.227612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:17.227612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:17.229024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:17.234564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5cf6-874b-4b4d-8ef5-c18e30aad377 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:17.235017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5cf6-874b-4b4d-8ef5-c18e30aad377 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:17.235135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5cf6-874b-4b4d-8ef5-c18e30aad377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:17.300299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:17.303134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c42b5cf6-874b-4b4d-8ef5-c18e30aad377 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:17.304356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c42b5cf6-874b-4b4d-8ef5-c18e30aad377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:17.407206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:17.713825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:17.715381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:17.839311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb91-bcc5-405f-ac9e-462204e5075d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:17.894810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:17.921643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:17.922261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:17.922539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:17.922811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:17.924463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:18.057526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:18.059240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6419e-f3e1-49aa-ba3f-0eacc6813d33 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:18.079448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 737/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:20.479863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:20.480483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:20.480483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:20.482604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:20.488804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc69e-e7e8-46f1-b936-f5552c13ab09 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:20.489327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc69e-e7e8-46f1-b936-f5552c13ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:20.489444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddc69e-e7e8-46f1-b936-f5552c13ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:20.566273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bdddc69e-e7e8-46f1-b936-f5552c13ab09 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:20.567516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bdddc69e-e7e8-46f1-b936-f5552c13ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:20.602146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:20.678831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:20.983386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:20.984953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:21.096866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1793b8-11bb-430c-b3dc-3d2100e12cc7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:21.130925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:21.195883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:21.196502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:21.196809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:21.197080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:21.198716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:21.319231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:21.320622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264a80-9a71-4601-a4f4-6120780bcac5 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:21.339458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 720/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:23.701834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:23.702382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:23.702382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:23.703734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:23.709275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d543-7e28-4cf5-967f-b7a55275bb21 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:23.709810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d543-7e28-4cf5-967f-b7a55275bb21 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:23.709995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d543-7e28-4cf5-967f-b7a55275bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:23.790553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2b87d543-7e28-4cf5-967f-b7a55275bb21 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:23.791771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2b87d543-7e28-4cf5-967f-b7a55275bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:23.800916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:23.894355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:24.183031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:24.184990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:24.297034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6b88-ead6-4165-a034-1b7b8c222888 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:24.362033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:24.386553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:24.387176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:24.387455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:24.387725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:24.389435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:24.529598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:24.531041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916c03e-f90f-411d-b167-e7497611d525 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:24.550655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 740/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:26.876404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:26.877067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:26.877067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:26.878362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:03:26.884644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d2cb-678c-4d98-9a9f-ac763fe084ca None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:26.885138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d2cb-678c-4d98-9a9f-ac763fe084ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:26.885250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7d2cb-678c-4d98-9a9f-ac763fe084ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:26.964215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7cb7d2cb-678c-4d98-9a9f-ac763fe084ca None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:26.965486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7cb7d2cb-678c-4d98-9a9f-ac763fe084ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:27.007265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:27.071679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:27.380228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:27.383239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:27.531378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdccdc-ecdf-4229-a375-a4922c4fbf03 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:27.584185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:27.614202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:27.615443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:27.615934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:27.616342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:27.618016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:27.748069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:27.749710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9db64-b7fb-4fe3-bd23-1ed60f79a259 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:27.769524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 723/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:30.036282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.036924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.037037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.038358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:30.045871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1123de4-68c3-46f7-a5ca-425a081caff3 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.046389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1123de4-68c3-46f7-a5ca-425a081caff3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.046503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1123de4-68c3-46f7-a5ca-425a081caff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.122429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c1123de4-68c3-46f7-a5ca-425a081caff3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.123701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c1123de4-68c3-46f7-a5ca-425a081caff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.141901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:30.226349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.523461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.525062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.641190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d788a-90d7-4aeb-b965-89bf266d5a8a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.738577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:30.748307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.748974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.749254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.753141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.753141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.885743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.887201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566dc22-455d-4c3d-bd43-3f51f183ab2b service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.908155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 743/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:33.185776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.186342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.186342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.187684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:33.193279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3280-c580-4a25-ac2a-5f2fc6147a74 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.193720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3280-c580-4a25-ac2a-5f2fc6147a74 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.193825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3280-c580-4a25-ac2a-5f2fc6147a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.262789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-748c3280-c580-4a25-ac2a-5f2fc6147a74 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:33.263998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-748c3280-c580-4a25-ac2a-5f2fc6147a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:33.315007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.367073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:33.659080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.660722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:33.772187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915726-f0ac-46eb-81dc-8c640f78d23e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.858876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.887791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.888405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.888711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.888986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.890628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.015738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.018101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549a3e-611b-463e-b834-8cc55ae09a77 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.038546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 726/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:43.386938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=22 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:44.035595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=66 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:55.494527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa09f3-ba6b-4304-ae88-d30351c38d84 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.495243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa09f3-ba6b-4304-ae88-d30351c38d84 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.495243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa09f3-ba6b-4304-ae88-d30351c38d84 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.496444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 745/1471] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:55.502043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0375-8ab9-4c8c-bc5d-b20ac6038d64 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.502802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0375-8ab9-4c8c-bc5d-b20ac6038d64 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.503034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0375-8ab9-4c8c-bc5d-b20ac6038d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.578952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5fde0375-8ab9-4c8c-bc5d-b20ac6038d64 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:55.580171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5fde0375-8ab9-4c8c-bc5d-b20ac6038d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.695026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 727/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:56.015589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.015882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.016154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.017539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 746/1473] 10.222.0.33 () {54 vars in 961 bytes} [Thu Sep 8 14:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:03:56.023687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f181-ffa9-4b6c-8cc4-b763bc867a61 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.023965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f181-ffa9-4b6c-8cc4-b763bc867a61 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.024242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f181-ffa9-4b6c-8cc4-b763bc867a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.122676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-be66f181-ffa9-4b6c-8cc4-b763bc867a61 None None] MFA Rules not processed for user `5b1ae9fed0454cb390554e3ad0ef580e`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:56.123974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-be66f181-ffa9-4b6c-8cc4-b763bc867a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:56.149450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:56.220618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 728/1474] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Sep 8 14:03:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:56.229149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:56.230799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:56.394333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101956-08f4-4f84-9179-aadcb5ff318f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:56.499125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:56.499967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.500121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.500287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.502051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:56.568231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:56.631851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:56.634431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef9451-2e24-4748-aaa6-8587c745e233 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:56.657215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 747/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:03:59.106738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.107337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.107548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.109177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 729/1476] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:59.115999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073ec1-2ec1-4eec-b968-38e47779e5e1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.116916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073ec1-2ec1-4eec-b968-38e47779e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.116916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073ec1-2ec1-4eec-b968-38e47779e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.191197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9e073ec1-2ec1-4eec-b968-38e47779e5e1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:59.192447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9e073ec1-2ec1-4eec-b968-38e47779e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:59.300425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 748/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:59.589565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.591254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:59.750919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320c04-f486-4fe0-9345-c7bd6b141efc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.815779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:59.890498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.891000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.891281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.891554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.892224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.894269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:59.894269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:03:59.894269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:03:59.895400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce523a40-6e39-49e2-b024-21a888248946 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.917204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 730/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Sep 8 14:03:59 2022] GET /identity/v3/projects => generated 2553 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:02.324421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:02.325087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:02.325087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:02.326342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 749/1479] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:04:02.332890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24975f-3b3f-4e6f-b826-11b06041328f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:02.334089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24975f-3b3f-4e6f-b826-11b06041328f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:02.334089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24975f-3b3f-4e6f-b826-11b06041328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:02.408785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2f24975f-3b3f-4e6f-b826-11b06041328f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:02.410108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2f24975f-3b3f-4e6f-b826-11b06041328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:02.520093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 731/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:02.827705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:02.829712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:02.843071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:03.027396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1fc2-9bff-4e1f-b0e8-c63c1b28269e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:03.131753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:03.177000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:03.178203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:03.178532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:03.178815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:03.180551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:03.306890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:03.308657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb754fb-0d55-4f77-8538-0380c0030337 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:03.332465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 750/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:05.853042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.853678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.853678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.855046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 732/1482] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:04:05.861474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab5188-3ee7-4fa4-8441-326aff85812e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.862338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab5188-3ee7-4fa4-8441-326aff85812e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.862338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab5188-3ee7-4fa4-8441-326aff85812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.950253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d2ab5188-3ee7-4fa4-8441-326aff85812e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:05.951507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d2ab5188-3ee7-4fa4-8441-326aff85812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:06.007427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:06.063281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 751/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:06.364220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:06.367202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:06.396325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:06.481724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909bc55-2d98-4ee2-828f-91e514fc4997 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:06.564929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:06.565471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:06.565841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:06.566177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:06.568776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:06.663276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:06.705139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:06.706604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879a01d-8f28-4a89-b212-19c76d83cd0f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:06.729907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 733/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:09.130832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:09.131660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:09.131861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:09.133371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 752/1485] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:04:09.139074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa41b5-ba10-4ba2-8a63-cbc8023e1675 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:09.139571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa41b5-ba10-4ba2-8a63-cbc8023e1675 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:09.142820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa41b5-ba10-4ba2-8a63-cbc8023e1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:09.221344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6caa41b5-ba10-4ba2-8a63-cbc8023e1675 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:09.222566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6caa41b5-ba10-4ba2-8a63-cbc8023e1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:09.332434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 734/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:09.653036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:09.654749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:09.806317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1e908-49f7-47b6-9259-04b86f9139b4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:09.906953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:09.908982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:09.909661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:09.909997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:09.910390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:09.912918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:10.094833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:10.100261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05a044-0ccd-4c1e-9a7a-07443348e61b service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:10.121829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 753/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:12.639470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:12.640063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:12.640063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:12.641419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 735/1488] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:04:12.649622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385c0b-6ca9-435e-87c9-e2d33b4ef570 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:12.650181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385c0b-6ca9-435e-87c9-e2d33b4ef570 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:12.650320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385c0b-6ca9-435e-87c9-e2d33b4ef570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:12.749492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b0385c0b-6ca9-435e-87c9-e2d33b4ef570 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:12.750737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b0385c0b-6ca9-435e-87c9-e2d33b4ef570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:12.813990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:12.865969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 754/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:13.179633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:13.181237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:13.224641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:13.316193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f527f6-acab-43b0-bd7c-b9dc3703fcce None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:13.397936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:13.398547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:13.398826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:13.399097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:13.400736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:13.501986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:13.538042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:13.541495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114934bc-996a-4145-9442-5e1266ce2a05 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:13.568199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 736/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:16.590667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:16.591237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:16.591237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:16.592867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 755/1491] 10.222.0.33 () {54 vars in 927 bytes} [Thu Sep 8 14:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:04:16.599575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995da6-80fe-4a9f-82d6-9a4c85bc2531 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:16.600663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995da6-80fe-4a9f-82d6-9a4c85bc2531 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:16.600663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995da6-80fe-4a9f-82d6-9a4c85bc2531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:16.676743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-13995da6-80fe-4a9f-82d6-9a4c85bc2531 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:16.679155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-13995da6-80fe-4a9f-82d6-9a4c85bc2531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:16.786228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 737/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Thu Sep 8 14:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:17.103329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:17.104916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:17.221683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d76ae-376b-4dcd-85b7-4646da2d5955 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:17.308249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:17.308897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:17.309186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:17.309463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:17.311349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:17.321904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:17.431307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:17.432676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c362-13d2-4e4e-b420-79fff68739c3 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:17.452034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 756/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:26.784320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=82 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:27.449704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=50 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:47.299088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.299752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.299871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.383198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:47.384758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:47.492581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 738/1494] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:47.500813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.501357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.501357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.522199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:47.523417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:47.531984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 757/1495] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:47.536896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:47.547255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41722c2-d2f7-4917-a328-f90ca7211a17 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:47.571847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:47.571847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.571847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.571847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:47.572651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 739/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:05:47.579831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:47.590638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7bcc7-648f-4e43-a5a3-0696ba3c14c8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:47.595601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:47.596216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.596501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.596807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.597452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:47.599416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:47.599416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:05:47.599416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:05:47.600657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:47.727603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 758/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:47 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:47.731919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:47.743332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae1dc4-a5a2-44d5-b107-14d48efb59b6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:47.806483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:47.813647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:47.814271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.814609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.814892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.815549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:47.816603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:47.816603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:05:47.816603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:05:47.818633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:47.935978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 740/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:47 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:47.937230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:47.948980 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515cdc-545f-46f3-aa19-1c7f0b15d6da admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:47.954000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:47.954635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.954915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.955259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.955937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:47.956999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:47.956999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:05:47.956999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:05:47.957990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:47.976471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 759/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:47.980874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:47.991667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2a9fa-9cbc-45b5-8b9c-3bbfc65a8bc6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:47.996407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:47.997145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:47.997428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:47.997793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:47.998443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:47.999470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:47.999470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:05:47.999470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:05:48.000350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f13e3-51a9-40eb-ad69-e538413c861d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.016956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 741/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:48.021284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:48.034758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6363ab4-1cd6-4947-98b6-f4c7ad0798c2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:48.040718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:48.041400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.041683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.041958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] PATH_INFO: `/v3/projects/0a978c5b971449f193c621d46179c39e/users/c74c34f931c348bbad783f260d4ea0e3/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.059125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a978c5b971449f193c621d46179c39e, user_id=c74c34f931c348bbad783f260d4ea0e3, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:48.060165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:48.060165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:05:48.060165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:05:48.062151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cee2c-8b25-405b-b629-20965e060047 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.137597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 760/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:48 2022] PUT /identity/v3/projects/0a978c5b971449f193c621d46179c39e/users/c74c34f931c348bbad783f260d4ea0e3/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:48.150506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757377d5-909f-46e4-b1ce-63527ce4458e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.150796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757377d5-909f-46e4-b1ce-63527ce4458e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.156401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757377d5-909f-46e4-b1ce-63527ce4458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.180874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-757377d5-909f-46e4-b1ce-63527ce4458e None None] MFA Rules not processed for user `c74c34f931c348bbad783f260d4ea0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:48.182153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-757377d5-909f-46e4-b1ce-63527ce4458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:48.248356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 742/1502] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:48.266478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4532-02fc-4611-972f-967b9316738a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.266824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4532-02fc-4611-972f-967b9316738a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.267109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4532-02fc-4611-972f-967b9316738a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.268499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 761/1503] 10.222.0.33 () {54 vars in 964 bytes} [Thu Sep 8 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:05:48.274124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0164b0-3430-4b93-a99a-0b9239619e4f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.274416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0164b0-3430-4b93-a99a-0b9239619e4f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.274720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0164b0-3430-4b93-a99a-0b9239619e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.342001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-dc0164b0-3430-4b93-a99a-0b9239619e4f None None] MFA Rules not processed for user `f9cdf8633c7740629b6956f631959f04`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:48.343219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dc0164b0-3430-4b93-a99a-0b9239619e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:48.427622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 743/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Sep 8 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:48.435673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4532-02fc-4611-972f-967b9316738a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:48.447490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4532-02fc-4611-972f-967b9316738a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:48.451162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:48.451767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.452050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.452324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.461087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:48.462520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.471458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 762/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:48.524195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8933-0935-4c69-9294-54ea7b497311 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.524490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8933-0935-4c69-9294-54ea7b497311 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.524800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8933-0935-4c69-9294-54ea7b497311 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.526068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 744/1506] 10.222.0.33 () {52 vars in 830 bytes} [Thu Sep 8 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:05:48.529903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:48.593157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f159d9-cc80-402a-a656-5f29887202c4 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:48.598458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:48.599098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.599382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.599661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] PATH_INFO: `/v3/users/c74c34f931c348bbad783f260d4ea0e3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.600848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74c34f931c348bbad783f260d4ea0e3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:48.601869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:48.601869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:05:48.601869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:05:48.603070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.827893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74c34f931c348bbad783f260d4ea0e3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.948213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74c34f931c348bbad783f260d4ea0e3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.948893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74c34f931c348bbad783f260d4ea0e3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.976125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74c34f931c348bbad783f260d4ea0e3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.986718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:48.991422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74c34f931c348bbad783f260d4ea0e3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.997615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 763/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:48 2022] DELETE /identity/v3/users/c74c34f931c348bbad783f260d4ea0e3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:49.002370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:49.002665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:49.002954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:49.022929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:49.024142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:49.037621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:49.086652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 745/1508] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:49.097631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:49.099908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:49.181378 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211d28-57c8-44a2-86f1-af48457e7ae1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:49.185412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:49.186039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:49.186366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:49.186625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:49.198096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:49.199569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c234d-f9fa-411f-9079-6c50c501005f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:49.219507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 764/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:49.710647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:49.712127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:49.725018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9ea4-0275-4d99-b06e-f485a204254a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:49.729747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:49.730388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:49.730670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:49.730940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] PATH_INFO: `/v3/projects/0a978c5b971449f193c621d46179c39e` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:49.733420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a978c5b971449f193c621d46179c39e)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:49.734455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:05:49.734455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:05:49.734455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:05:49.735724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:49.870016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a978c5b971449f193c621d46179c39e', 'request_id': 'req-a594a44b-adff-4b01-a925-106f9dd203eb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:49.948248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a978c5b971449f193c621d46179c39e', 'request_id': 'req-a594a44b-adff-4b01-a925-106f9dd203eb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:49.958706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a978c5b971449f193c621d46179c39e', 'request_id': 'req-a594a44b-adff-4b01-a925-106f9dd203eb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:49.975986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] The token cache is being invalidate because project 0a978c5b971449f193c621d46179c39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:49.976281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:49.976964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a594a44b-adff-4b01-a925-106f9dd203eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:49.978566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 746/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:49 2022] DELETE /identity/v3/projects/0a978c5b971449f193c621d46179c39e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:59.303654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=38 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:59.971866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:28.739697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:28.740317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:28.740317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:28.741685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:28.746853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29d6e-6cd1-467f-9291-571fc48c4f3b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:28.747402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29d6e-6cd1-467f-9291-571fc48c4f3b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:28.747402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29d6e-6cd1-467f-9291-571fc48c4f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:28.769456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-35d29d6e-6cd1-467f-9291-571fc48c4f3b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:28.770684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-35d29d6e-6cd1-467f-9291-571fc48c4f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:28.831637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:28.986836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:28.989109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:29.093273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4713bd-81c9-4c88-8d0c-05cf1afdfa2d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:29.099529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:29.100135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:29.100416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:29.100724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:29.109125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:29.110697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081f91-2137-4c92-811a-4a4fb1c10b50 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:29.120891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 766/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:30.221803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bc1a-847c-43dc-9354-ce14fbd5549b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.222366 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bc1a-847c-43dc-9354-ce14fbd5549b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.222481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36bc1a-847c-43dc-9354-ce14fbd5549b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.223786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 748/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:30.230327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb819dc3-8892-4191-a944-ce8da394cbd6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.230772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb819dc3-8892-4191-a944-ce8da394cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.230885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb819dc3-8892-4191-a944-ce8da394cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.251105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cb819dc3-8892-4191-a944-ce8da394cbd6 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:30.252326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb819dc3-8892-4191-a944-ce8da394cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.260888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 767/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:30.413885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36bc1a-847c-43dc-9354-ce14fbd5549b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.429247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36bc1a-847c-43dc-9354-ce14fbd5549b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:30.434683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:30.435315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.435598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.435873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.445654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:30.447302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c04b74-05ae-43fc-b0df-8ee563d67a96 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:30.457647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 749/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:30.614653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680dad-0610-4006-ba91-6aa70f097ae1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.614978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680dad-0610-4006-ba91-6aa70f097ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.615259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680dad-0610-4006-ba91-6aa70f097ae1 None None] PATH_INFO: `/v3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.616597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 768/1517] 10.222.0.85 () {54 vars in 925 bytes} [Thu Sep 8 14:07:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:07:30.623715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17a8a-929b-4b32-b9a4-7f0bfe5fb365 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.624086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17a8a-929b-4b32-b9a4-7f0bfe5fb365 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.624387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17a8a-929b-4b32-b9a4-7f0bfe5fb365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.676923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f7c17a8a-929b-4b32-b9a4-7f0bfe5fb365 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:30.678240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f7c17a8a-929b-4b32-b9a4-7f0bfe5fb365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.750816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 750/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:40.246327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=49 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:40.747777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=77 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:41.036132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed88c5-eafc-4d1a-b3ea-9db2ad2c436e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.036393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed88c5-eafc-4d1a-b3ea-9db2ad2c436e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.036614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed88c5-eafc-4d1a-b3ea-9db2ad2c436e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.038084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 769/1519] 10.222.0.33 () {54 vars in 961 bytes} [Thu Sep 8 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:41.043325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a5ebf-bc80-4fee-94c6-47f995b3196a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.043622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a5ebf-bc80-4fee-94c6-47f995b3196a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.043904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a5ebf-bc80-4fee-94c6-47f995b3196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.070124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-366a5ebf-bc80-4fee-94c6-47f995b3196a None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:41.071336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-366a5ebf-bc80-4fee-94c6-47f995b3196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:41.081279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 751/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Sep 8 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:41.089536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed88c5-eafc-4d1a-b3ea-9db2ad2c436e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:41.103539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed88c5-eafc-4d1a-b3ea-9db2ad2c436e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:41.109105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:41.109719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.110003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.110279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.120128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:41.121795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74afe29-8b1f-48fc-bc56-62cf1821f7c4 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:41.137657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 770/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:42.047075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952fea7-10ee-4ef6-b247-6cf0ce5d4f3d None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.047616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952fea7-10ee-4ef6-b247-6cf0ce5d4f3d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.047616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952fea7-10ee-4ef6-b247-6cf0ce5d4f3d None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.049848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:42.057068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb08ad-1f53-4a27-be2b-e29f9b89613b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.057589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb08ad-1f53-4a27-be2b-e29f9b89613b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.057743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb08ad-1f53-4a27-be2b-e29f9b89613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.079535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bbcb08ad-1f53-4a27-be2b-e29f9b89613b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:42.080848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bbcb08ad-1f53-4a27-be2b-e29f9b89613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:42.089081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:42.265689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952fea7-10ee-4ef6-b247-6cf0ce5d4f3d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:42.280663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952fea7-10ee-4ef6-b247-6cf0ce5d4f3d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:42.286849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:42.287489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.287769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.288046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.296849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:42.298443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa1095-db50-442b-991b-5b204fd8a809 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:42.309174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 753/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:43.408976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e80f7-c55b-4b0a-86b7-75ad706451d9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:43.410026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e80f7-c55b-4b0a-86b7-75ad706451d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:43.410026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e80f7-c55b-4b0a-86b7-75ad706451d9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:43.411133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:43.418163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eee4-ad2c-4f0a-85f8-afde43476d22 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:43.418745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eee4-ad2c-4f0a-85f8-afde43476d22 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:43.418745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eee4-ad2c-4f0a-85f8-afde43476d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:43.440791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-cbf8eee4-ad2c-4f0a-85f8-afde43476d22 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:43.442045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cbf8eee4-ad2c-4f0a-85f8-afde43476d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:43.450287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:43.604843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e80f7-c55b-4b0a-86b7-75ad706451d9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:43.621162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e80f7-c55b-4b0a-86b7-75ad706451d9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:43.629974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:43.630597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:43.630875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:43.631148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:43.640205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:43.641832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f8b29-e2a7-440d-a901-403ac3947927 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:43.652024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 773/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:47.860484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:47.861088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:47.861088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:47.863386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:47.868795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15368fe7-1076-47ec-a4d2-c7b93cf3017f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:47.869395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15368fe7-1076-47ec-a4d2-c7b93cf3017f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:47.869395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15368fe7-1076-47ec-a4d2-c7b93cf3017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:47.891636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-15368fe7-1076-47ec-a4d2-c7b93cf3017f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:47.892938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-15368fe7-1076-47ec-a4d2-c7b93cf3017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:47.901047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:48.213398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:48.215312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:48.280161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc79d4-f548-474f-808f-079f0bfb26f4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:48.284358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:48.285237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:48.285523 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:48.285797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:48.295538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:48.297046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b9827-4c39-4d8a-a5d4-82242506626e service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:48.308174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 756/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:50.547659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c660399-6de7-4ee6-892d-d6a9460611ab None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.548251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c660399-6de7-4ee6-892d-d6a9460611ab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.548251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c660399-6de7-4ee6-892d-d6a9460611ab None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.550206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:50.556095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ff51-e99f-4dd0-a5ba-c1fc296fd2c1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.556646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ff51-e99f-4dd0-a5ba-c1fc296fd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.556764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ff51-e99f-4dd0-a5ba-c1fc296fd2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.579001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6807ff51-e99f-4dd0-a5ba-c1fc296fd2c1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:50.580400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6807ff51-e99f-4dd0-a5ba-c1fc296fd2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:50.588856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:50.880133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c660399-6de7-4ee6-892d-d6a9460611ab None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:50.890976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c660399-6de7-4ee6-892d-d6a9460611ab None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:50.895604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:50.896380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.896680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.897027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.906296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:50.907720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b1a9-6ed4-4434-bdb4-95f896de6d0e service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:50.917958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 776/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:55.226239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:55.226975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:55.226975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:55.228090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:55.234018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784ee4-af1f-44d8-983e-c0d6c9e53c98 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:55.234535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784ee4-af1f-44d8-983e-c0d6c9e53c98 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:55.234746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e784ee4-af1f-44d8-983e-c0d6c9e53c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:55.258106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3e784ee4-af1f-44d8-983e-c0d6c9e53c98 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:55.259347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e784ee4-af1f-44d8-983e-c0d6c9e53c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:55.267625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:55.576286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:55.578023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:55.639841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e03e-593a-4738-aac5-e276713f769f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:55.643953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:55.644671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:55.644898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:55.645171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:55.656651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:55.658407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728643a-0df1-4217-b45d-17a3be3fcf25 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:55.669722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 759/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:57.859780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:57.860319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:57.860319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:57.861683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:57.867247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa367-f1b9-4947-a37c-e599f6c4d98f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:57.867733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa367-f1b9-4947-a37c-e599f6c4d98f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:57.867844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fa367-f1b9-4947-a37c-e599f6c4d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:57.887194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4b7fa367-f1b9-4947-a37c-e599f6c4d98f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:57.888386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4b7fa367-f1b9-4947-a37c-e599f6c4d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:57.897814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:58.203803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:58.206353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:58.219746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdba3e-90b6-421d-ac19-9af35f8b9715 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:58.223566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:58.224169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:58.224452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:58.224750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:58.234533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:58.235955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f11c8-de47-4d39-ac29-c17d7385e6c6 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:58.245926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 779/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:08:07.881952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=70 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:08.241541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=33 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:28.217368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.218140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.218140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.255279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.256583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.274834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 761/1540] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.286414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.287036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.287255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.342329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.344368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.362109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 780/1541] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.367603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.391817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41129-9535-4d29-9134-209fb733ac19 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:28.402800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:28.403439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.403750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.404004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.404700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:28.405013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:28.406864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:28.426952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 762/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:28.435605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.446347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce96697-67c8-4f24-952e-bf17a778dfa1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:28.455440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:28.456260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.456562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.456840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.457486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:28.459404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e619199-b970-430c-ab7c-4fc52b020260 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:28.563665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 781/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:28.568668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.573169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bff9e8-01c6-455a-9532-b12c2cb4dde4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.573564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bff9e8-01c6-455a-9532-b12c2cb4dde4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.573741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bff9e8-01c6-455a-9532-b12c2cb4dde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.582733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc909cf-7aa4-4357-a93c-da5859f8cfcf admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:28.604716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f1bff9e8-01c6-455a-9532-b12c2cb4dde4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.605976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f1bff9e8-01c6-455a-9532-b12c2cb4dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.704435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:28.705096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.705385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.705664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.706319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:28.708498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269640-62ad-4b59-935c-cc6ab5419818 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:28.736412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 782/1544] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:28.741400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428cb8-0b1a-46da-ac28-ce6cc9a08067 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.741400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428cb8-0b1a-46da-ac28-ce6cc9a08067 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.741400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87428cb8-0b1a-46da-ac28-ce6cc9a08067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.773098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-87428cb8-0b1a-46da-ac28-ce6cc9a08067 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.774367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-87428cb8-0b1a-46da-ac28-ce6cc9a08067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.788548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 783/1545] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.789954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.790246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.790520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.811402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 763/1546] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:28.813052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.813353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.813797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.819534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.820849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.839399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 784/1547] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.840272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.857088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.857332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956c91-c348-4304-891b-d3aa525b0f26 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:28.858375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.869464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:28.870175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.870516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.870794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.871472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:28.873502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef4668-3bb1-41cc-8414-8d9f64c4ee9a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:28.881340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 764/1548] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.883428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.896374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 785/1549] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:28.898677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.901055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.909753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.909899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03839fc8-8b32-4c28-a504-0742ced1d5d4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:28.918896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:28.920729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:28.921817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:28.924817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:28.925528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:28.925845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:28.932459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:28.947593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:28.951204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:28.958641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 765/1550] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:28.960364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.975507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 786/1551] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:28.978478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:28.996657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f0d19-fbde-4336-b3f1-1959410dc016 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.008741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a842c-45ea-4e41-950e-c39848cf2d2f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.012701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.013391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.018679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.018679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.018679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:29.018679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.018679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.023469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.024108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.025835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.026117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.027241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.033567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2c77c-d76e-4fb2-90b2-5df5aeeb99f9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.052016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 766/1552] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:29.052690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.054091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 787/1553] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:29.059653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c5a1-2de2-4f3b-b8f6-96800c3fd235 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.059941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c5a1-2de2-4f3b-b8f6-96800c3fd235 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.060220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53c5a1-2de2-4f3b-b8f6-96800c3fd235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.069966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528543a-4fb4-4720-bb6d-dcf40b727864 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.074630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.075876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.075876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.076120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.076640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.077692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:29.077692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:09:29.077692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:09:29.079546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ce3b-2442-4b6b-9637-559c371b9a68 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.085524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0f53c5a1-2de2-4f3b-b8f6-96800c3fd235 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.086954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0f53c5a1-2de2-4f3b-b8f6-96800c3fd235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.096145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 788/1554] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.098104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509b390-27ec-4c44-b379-2d5d6f3f5a9a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.098453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509b390-27ec-4c44-b379-2d5d6f3f5a9a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.098882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509b390-27ec-4c44-b379-2d5d6f3f5a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.126084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5509b390-27ec-4c44-b379-2d5d6f3f5a9a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.127317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5509b390-27ec-4c44-b379-2d5d6f3f5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.135845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 789/1555] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.137131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.137473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.137752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.159452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.160712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.168538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 790/1556] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.169324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.179238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288560ee-a373-40dd-bc2a-30a0f30d86c5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.184147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.184830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.185114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.185380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] PATH_INFO: `/v3/projects/d338a7f58c2744b1a69eb7c4ca70f3da/users/3aefc0ca2a654a26bbd0236e2a0ec6ce/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.202079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=d338a7f58c2744b1a69eb7c4ca70f3da, user_id=3aefc0ca2a654a26bbd0236e2a0ec6ce, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.205296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.261912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 767/1557] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:29.263404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.263691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.263965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.284745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.286001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.352721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 768/1558] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.353486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.367916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 791/1559] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:29 2022] PUT /identity/v3/projects/d338a7f58c2744b1a69eb7c4ca70f3da/users/3aefc0ca2a654a26bbd0236e2a0ec6ce/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:29.369994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.370174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d1e0f-6fc0-4855-9c1c-e31ba43aa28b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.387380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:29.425807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:29.440741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dbf03-3716-4784-83ac-7d297f4d6ada admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.445762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.446586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.446739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.446922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.447635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:29.447876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.449152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.449320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:29.449320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:09:29.449320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:09:29.449660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.449660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.449836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9043614-4cf1-4f5f-88c5-adf84505667c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.449936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.450636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.453439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512ee66-d57e-4a5b-bc35-c17a223426c5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.462822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 792/1560] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:29.464110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ed7c-7fdf-4c21-9c05-9769d0ab6d9d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.464397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ed7c-7fdf-4c21-9c05-9769d0ab6d9d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.464706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ed7c-7fdf-4c21-9c05-9769d0ab6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.487916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c5e4ed7c-7fdf-4c21-9c05-9769d0ab6d9d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.488880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c5e4ed7c-7fdf-4c21-9c05-9769d0ab6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.497928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 793/1561] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.504908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a338-2c24-4d4f-8b1a-30b5521ffad7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.504908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a338-2c24-4d4f-8b1a-30b5521ffad7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.504908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a338-2c24-4d4f-8b1a-30b5521ffad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.523828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b307a338-2c24-4d4f-8b1a-30b5521ffad7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.525264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b307a338-2c24-4d4f-8b1a-30b5521ffad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.534537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 794/1562] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.539289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.539289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.539289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.559415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.560703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.570207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 795/1563] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.574013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.581535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101690aa-fbe4-45c2-97bc-79bd45723d9b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.586332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.586941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.587220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.587490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.588216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.589216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:29.589216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:09:29.589216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:09:29.590417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.609930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 769/1564] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:29.611105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a840-5343-4215-9021-69f0da4dc0ba None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.611399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a840-5343-4215-9021-69f0da4dc0ba None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.611682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a840-5343-4215-9021-69f0da4dc0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.633094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-58b5a840-5343-4215-9021-69f0da4dc0ba None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.634370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-58b5a840-5343-4215-9021-69f0da4dc0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.732563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 770/1565] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.734199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cd8-aebe-479c-96f0-aac4c2c476f1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.734499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cd8-aebe-479c-96f0-aac4c2c476f1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.734780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec594cd8-aebe-479c-96f0-aac4c2c476f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.765425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 796/1566] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:29.769724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.771086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ec594cd8-aebe-479c-96f0-aac4c2c476f1 None None] MFA Rules not processed for user `3aefc0ca2a654a26bbd0236e2a0ec6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.773184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ec594cd8-aebe-479c-96f0-aac4c2c476f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.779182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661809b-aee7-4cf5-8269-54bae793f76f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.785530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.786182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.786465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.786822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.787501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.789508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.848274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 771/1567] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.849657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.849964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.850247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.872455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:29.873682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:29.883230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 772/1568] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:29.884075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.892107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 797/1569] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:29.894396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.894969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c800b5-74ac-4bec-b59b-a75eff0efdff None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.916017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:29.955713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.956329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.956643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.956920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.957569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:29.957872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.959558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.966114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226ae40-629c-40ab-9357-054c67ec3322 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.967896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.971675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.971675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.971675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.971675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:29.971675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.972794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 773/1570] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:29.972882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.974006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.985768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a77f1-4e04-4dfe-9bfe-36a57a5b5083 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:29.986027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 798/1571] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:29.986718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:29.990933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:29.991679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:29.992024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:29.992471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:29.993244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:29.995239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:29.997801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25865-4711-42fa-ba05-1340847f5088 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.003603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.004217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.004499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.004825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.005474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:30.005782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.007389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.029541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 799/1572] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:30.030333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.041111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c957ef-8027-429c-bfe2-552f28aee76f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.046034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.047176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.047699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.047949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.048857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.050366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9411e18-5b41-4a8b-8c99-c9807140e855 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.061652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 800/1573] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:30.063654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9ed9-6adc-450e-ab4d-968327b5a3a1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.063946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9ed9-6adc-450e-ab4d-968327b5a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.064228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d9ed9-6adc-450e-ab4d-968327b5a3a1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.065597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 801/1574] 10.222.0.33 () {54 vars in 962 bytes} [Thu Sep 8 14:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:30.067888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d9ed9-6adc-450e-ab4d-968327b5a3a1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.083544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d9ed9-6adc-450e-ab4d-968327b5a3a1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.088257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.090794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.091084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.091442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.092016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:30.092320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.094234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.102321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 774/1575] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:29 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:30.106424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.112674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 802/1576] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:30.115011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.124371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80226e6-19ec-4878-90f0-13f393933fb0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.126331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc52dd-61a9-48cb-b6e9-12cc10fdf48e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.130638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.131556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.131707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.132740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.133499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.135103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.135529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.136148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.136426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.136824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.137390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.140565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.353650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 803/1577] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:30.354527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.373523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:30.381086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 775/1578] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:30.381918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.392201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dec099-7fdf-4399-9875-14c515ddedb9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.431853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d484a78-1de8-4c6e-a954-8f491477a034 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.436564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.437207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.437828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.437935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.438595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.440587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.463726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.464367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.476192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.476192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.476192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.476192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b136-7ce3-451e-bf0d-0b30ff370566 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.725727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 804/1579] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/projects => generated 355 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:30.726579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.738974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 776/1580] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/projects => generated 385 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:30.738974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.738974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.738974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.786178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:30.787391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:30.804724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04538211-6683-46ec-bbc1-dbdd320550c6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.841227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:30.862487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.863110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.863222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 777/1581] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:30.863395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.863658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.863964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.864450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.866143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.875145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9c80-c096-480f-8f86-c0ce8ce52d73 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.880685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 805/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:30.880685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.880919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.880919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.881121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.881290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.881932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.883580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.887897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363692a5-3788-4189-884f-991a94dcc04f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.893677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.894367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.894645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.894792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 778/1583] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:30.894918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.895581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.895766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.898127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.905825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151f17-f990-4a31-ba29-5ccc3af4f50a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.911105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.911698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.911980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.912262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.912912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.914889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.006393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 806/1584] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:31.006393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.012972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 779/1585] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:30 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:31.013871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.025814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d31e-da8d-497e-bfd0-05f2be67c44d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.035948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:31.075009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76470e20-9e4f-4181-91a9-9a1b98035cb3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.080363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.081012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.081291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.081564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.082202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.083852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.086430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.087103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.087319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.087598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.088242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.090304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.093900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 807/1586] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.094710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.104704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254915c-0167-4252-b37a-9ba89bcbc674 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.110741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.111345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.118362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.118362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.118362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.118362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.210595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 780/1587] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:31 2022] POST /identity/v3/users => generated 278 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:31.211246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.238816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 808/1588] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:31 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:31.239888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.249591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd0c15-3c8b-4328-8b62-9cd046e92b91 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.255160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.255838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.256204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.256448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] PATH_INFO: `/v3/projects/2960953ab9db4018961d503506c2d42c/users/6815cf65c74d4a009faf12abfd8e046c/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.274588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2960953ab9db4018961d503506c2d42c, user_id=6815cf65c74d4a009faf12abfd8e046c, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.277342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.285452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7174884-3b6d-4603-aaac-c60635e9303a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.291075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.291685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.291969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.292246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.339173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:31.350347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 809/1589] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:31 2022] PUT /identity/v3/projects/2960953ab9db4018961d503506c2d42c/users/6815cf65c74d4a009faf12abfd8e046c/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:31.351197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.351465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.353121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.364007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 781/1590] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:31.364874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.375826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec1e9-8957-4a54-bf15-477af8630f05 service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.432268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7255e-856b-48dc-9f80-c44fb4e21104 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.436547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.437327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.438267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.438581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.439261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.440074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.440906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.445344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.445475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.445475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.445475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.445475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.456794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 810/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.457863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.467997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d534-5a52-436b-a5b7-c0028ee1785b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.473435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.474052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.474335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.474607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.475253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.477984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.488760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 811/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.489619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.500947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8c7c4-9dc6-4c4b-8326-dafa935111c8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.506374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.507082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.507461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.507795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.508506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.510303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.522720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 812/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.523447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.536939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233c80e-9b96-4cc8-9841-b62e0d1c84ea admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.541791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.542404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.542686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.542974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.543613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.545286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.556930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 813/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.557753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.568554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e3c57-a442-4c4e-bae5-1928fbb4b783 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.573842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.573842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.574071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.574240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.574876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.576448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22687091-4239-4386-a9d1-f5e569b67e49 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.587012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 814/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.588734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.588734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.588924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.610412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 782/1596] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:31 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:31.614533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.624378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c0a5c-bf0c-41a2-ad4b-e2dacc2dd0d3 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.630404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] MFA Rules not processed for user `6815cf65c74d4a009faf12abfd8e046c`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:31.631185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.631827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:31.632232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.632751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.633138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] PATH_INFO: `/v3/projects/94728edba1f94f6792948c4a0bd44845/users/3aab0f8c0858441aa04feaf57e3e1496/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.650222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=94728edba1f94f6792948c4a0bd44845, user_id=3aab0f8c0858441aa04feaf57e3e1496, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.651256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:31.651256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:09:31.651256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:09:31.653224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.653799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:31.708732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 815/1597] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:31.709592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.725201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf17b4e-f2c7-4a58-add9-fc438f35ff1e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.736360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.737718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.738070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.738403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.739211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.741312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.755832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 783/1598] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:31 2022] PUT /identity/v3/projects/94728edba1f94f6792948c4a0bd44845/users/3aab0f8c0858441aa04feaf57e3e1496/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:31.755832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.763334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 816/1599] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.765550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.780932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02442756-be58-4dca-9d07-9264f730518f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.881935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.885035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.885035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.885035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.885035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.885765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91141d-8312-4596-a46d-33c7539eb9ea admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.885921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.890270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.891104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.891388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.891670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] PATH_INFO: `/v3/projects/4914f03913a848bd9c98eb25ab9a7aae/users/d7ed6f26234840ef84d877189870b2ec/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.900566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 817/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.900566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.911307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4914f03913a848bd9c98eb25ab9a7aae, user_id=d7ed6f26234840ef84d877189870b2ec, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.912829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d3c1-4c64-49b9-8049-21b0f1ad6b47 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.914378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1597a-b3a0-41cb-b9cb-0e6c5ef894aa admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.918125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.919675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.919675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.919675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.920194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.923173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.934448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 818/1601] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.935427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:31.946346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3010cf-5aa0-4a74-bb3d-674ac67b1c14 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:31.951022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:31.951613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:31.951895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:31.952172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:31.952902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:31.955053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:31.965128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 819/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:31.965940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.024090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2948d-9d3c-4d32-93c6-b502886163cc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.026046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 784/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:31 2022] PUT /identity/v3/projects/4914f03913a848bd9c98eb25ab9a7aae/users/d7ed6f26234840ef84d877189870b2ec/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:32.027397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.027687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.027969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.057606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] MFA Rules not processed for user `3aab0f8c0858441aa04feaf57e3e1496`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:32.058823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:32.071994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.081663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.089977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.090595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.090874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.091148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.129637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 785/1604] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:32.130552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.151434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.152909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.163163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 820/1605] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:32.163991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.211090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f585-f354-4a1b-8b3f-3483c5481bb6 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.218133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.219582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.219892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.220169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] PATH_INFO: `/v3/projects/61d5b317b3684ff0a9a125147777d310/users/de5e483e3a234f539f4f00170a282885/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.241058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d5b317b3684ff0a9a125147777d310, user_id=de5e483e3a234f539f4f00170a282885, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.242985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68422f-2973-4f88-8cb4-8c33771ce086 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.244750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e83e7-03dc-4b6b-90b5-3495dd936060 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.247843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.248553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.248832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.249113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] PATH_INFO: `/v3/projects/1e2c2abf04ba4fa0a60b7bde03fc9c47/users/25a95e251a114dd7b5a427eb39f84aeb/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.267633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2c2abf04ba4fa0a60b7bde03fc9c47, user_id=25a95e251a114dd7b5a427eb39f84aeb, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.271072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.373006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 786/1606] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:32 2022] PUT /identity/v3/projects/61d5b317b3684ff0a9a125147777d310/users/de5e483e3a234f539f4f00170a282885/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:32.374358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635086-4be6-4a3a-a61d-9408595223fd None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.374651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635086-4be6-4a3a-a61d-9408595223fd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.376349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76635086-4be6-4a3a-a61d-9408595223fd None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.381876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 787/1607] 10.222.0.33 () {54 vars in 962 bytes} [Thu Sep 8 14:09:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:32.382673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635086-4be6-4a3a-a61d-9408595223fd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.405228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 821/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:32 2022] PUT /identity/v3/projects/1e2c2abf04ba4fa0a60b7bde03fc9c47/users/25a95e251a114dd7b5a427eb39f84aeb/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:32.406347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.472881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76635086-4be6-4a3a-a61d-9408595223fd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.490889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b6a9-23be-4849-9217-d4a7d795a780 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.495820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.496464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.502335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.502335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.502335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.502335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d805f5-b99d-4338-b935-28c86bac9279 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.510177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 822/1609] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:32.511210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.511502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.511783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.533881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.537358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.541965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] MFA Rules not processed for user `d7ed6f26234840ef84d877189870b2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:32.543198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:32.548105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.548957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.549332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.549715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] PATH_INFO: `/v3/projects/7a2dfeaed7b443eca8c347d9fb2688d0/users/dcb0911fad8c4d20ab2e832afd6bc51f/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.568501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2dfeaed7b443eca8c347d9fb2688d0, user_id=dcb0911fad8c4d20ab2e832afd6bc51f, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.571354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03348f0-eef1-4e98-869b-f39a4f92da11 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.615167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 823/1610] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:32.616044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.626816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a7288-4527-4ba0-b16c-028e5edfee7e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.631352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.632061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.632230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.632718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.633354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.635249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af191fef-7b38-48be-abc7-193268fe658f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.667630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 788/1611] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:32 2022] PUT /identity/v3/projects/7a2dfeaed7b443eca8c347d9fb2688d0/users/dcb0911fad8c4d20ab2e832afd6bc51f/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:32.669017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be285c5-a71e-4b36-8540-def856a003e0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.669309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be285c5-a71e-4b36-8540-def856a003e0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.669587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be285c5-a71e-4b36-8540-def856a003e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.689403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7be285c5-a71e-4b36-8540-def856a003e0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:32.690613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7be285c5-a71e-4b36-8540-def856a003e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:32.736145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 824/1612] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:32.738562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.738863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.741150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.753336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 789/1613] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:32.754711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.755064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.755406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.760587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:32.761808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:32.785621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] MFA Rules not processed for user `25a95e251a114dd7b5a427eb39f84aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:32.801944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:32.834364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 825/1614] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:32.835560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.859383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 790/1615] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:32.860370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:32.909005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a509-7cf5-402a-beeb-75ee3efffe16 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.913476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.914147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.914430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.914706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] PATH_INFO: `/v3/projects/3f50a27a77a948368ac15d4e018b39e7/users/4e2982e7cf254d408ebadaa62555b0dd/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.929370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bed9f-3a4e-4f08-ba98-6cbd6a0fb134 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:32.933694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f50a27a77a948368ac15d4e018b39e7, user_id=4e2982e7cf254d408ebadaa62555b0dd, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.934488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:32.935098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:32.935386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:32.935687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:32.936343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:32.936544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12814c4f-79e0-4097-9317-e86b9319faeb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.938433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:32.938989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:32.950264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:33.106430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 826/1616] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:32 2022] PUT /identity/v3/projects/3f50a27a77a948368ac15d4e018b39e7/users/4e2982e7cf254d408ebadaa62555b0dd/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:33.108318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 791/1617] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:32 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:33.109432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.111185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.111578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.111871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.134124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:33.149883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:33.181879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601bbbe-f89f-4bb6-ac42-5cf98514fb79 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.187802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.188562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.188849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.189123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.189923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.192253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5815fa7-28ac-440c-9746-75f57c368b96 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.219734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 827/1618] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:33.223798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.284689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e0a20-54d3-4424-8634-bc7c7a2f286b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.288972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.291103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.291393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.291684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.302905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.304986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.554427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 792/1619] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:33.554427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cc1df-565d-491f-9004-94fe73897009 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.554427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cc1df-565d-491f-9004-94fe73897009 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.554427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cc1df-565d-491f-9004-94fe73897009 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.556810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 828/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:33.557845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 793/1621] 10.222.0.33 () {54 vars in 912 bytes} [Thu Sep 8 14:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:33.557845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.557845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.557845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.558450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.558450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d7538-7e3f-4b9b-866c-94a17346cb3c service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.558450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.558450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.558738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.558738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.558738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.558738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.558961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:33.558961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:33.558961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 794/1622] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:33.558961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.558961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8f93-906c-4333-8067-38e1308f2d71 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.559222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.559222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.559222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.559222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.559490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.559490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.559598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 829/1623] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/projects => generated 355 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:33.559598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.559714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 795/1624] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:33.559714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.561765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee73db-b745-4789-8bf4-1a6d1075ea48 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.633724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9871-9a7c-49e8-9c9b-2d0a65160725 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.637615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.638258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.638542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.638819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.642000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.642718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.644909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.644909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.644909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.645626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba849a-54d4-4a0a-9f79-7f170d0451ad admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.649859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.651305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.656911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 796/1625] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:33.658124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.658413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.658690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.662662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 830/1626] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:33.663574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.674144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7ec4e-0b5d-4b44-8e6e-83300dc72d38 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.679040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.679975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.680335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.680728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.682263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:33.683494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:33.692286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.693783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.703947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 831/1627] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:33.704805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.711304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:33.716961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61235-6840-49c6-b4c1-b4b0c3e7300c service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.725342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.726108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.726517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.726883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.727650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.730718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.738807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:33.760919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 797/1628] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:33.761893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.772786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75308-f68d-43f0-be49-5036dbeecc6b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.777407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.778012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.778716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.778716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.779211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.781058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.791539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 798/1629] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:33.792450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.802703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca136e36-97fe-448f-b36e-1a6d054ce2e8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.809652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.810350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.810634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.810913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] PATH_INFO: `/v3/projects/69e730f2e45646188810324bb304b5b2/users/8767dbe845e14d569196fd38e5ea225b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:33.827400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e730f2e45646188810324bb304b5b2, user_id=8767dbe845e14d569196fd38e5ea225b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:33.830165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:33.866608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 832/1630] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:33 2022] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:33.866608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.929964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba2c00-701b-4ee3-b150-b5fb5d2155f3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:33.938428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 799/1631] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:33 2022] PUT /identity/v3/projects/69e730f2e45646188810324bb304b5b2/users/8767dbe845e14d569196fd38e5ea225b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:33.939949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:33.994157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:33.994950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:33.995240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:33.995521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.017706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df695d-4a97-4b51-b2aa-39202858cd20 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.023133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.023846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.031845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.031845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] PATH_INFO: `/v3/projects/20b999d3e8194a96a42ff70bcb917de9/users/1fd63c6f3a754c0a88b3e117f1c60587/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.055350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b999d3e8194a96a42ff70bcb917de9, user_id=1fd63c6f3a754c0a88b3e117f1c60587, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.058482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.090490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.091896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.105337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 833/1632] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:34.106207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.118185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4398c-0fd6-4c4d-8583-79186fec3931 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.123202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.125223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.125223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.125223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.125223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.126683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.145491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 834/1633] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:34.145491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.163716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995946e7-58f5-449f-8332-1f3a92179aa7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.171531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.173064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.173342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.173634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.174279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.176244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.189571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 835/1634] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:34.190647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.205368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf450e-e42d-49ee-bcc8-7b04a5bd0feb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.208573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 800/1635] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:33 2022] PUT /identity/v3/projects/20b999d3e8194a96a42ff70bcb917de9/users/1fd63c6f3a754c0a88b3e117f1c60587/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:34.209650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.251369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:34.296147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dbe7c-591f-4b9f-b6d0-5a12fb4d6298 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.303860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.304818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.305275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.305722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] PATH_INFO: `/v3/projects/69e730f2e45646188810324bb304b5b2/users/8767dbe845e14d569196fd38e5ea225b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.308447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e730f2e45646188810324bb304b5b2, user_id=8767dbe845e14d569196fd38e5ea225b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.311883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.336604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 801/1636] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:34 2022] PUT /identity/v3/projects/69e730f2e45646188810324bb304b5b2/users/8767dbe845e14d569196fd38e5ea225b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:34.338383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.365074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.366460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.366882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.367371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] PATH_INFO: `/v3/projects/79826e76995345f2adc9c6280b7f4f4b/users/a8de13c0eecb4be09c0963ada1ac093f/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.381145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:34.406814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79826e76995345f2adc9c6280b7f4f4b, user_id=a8de13c0eecb4be09c0963ada1ac093f, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.415430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.423015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2d7df-c996-48a3-aef1-f56f5dba38c9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.427995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.428655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.428938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.429210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.429971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.431759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ace6b3-d75f-43a8-8d80-bfe670fbdb63 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.443739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 802/1637] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:34.444848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82c59-7a3e-428d-92ca-8f1d8c48feae None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.445136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82c59-7a3e-428d-92ca-8f1d8c48feae None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.445410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e82c59-7a3e-428d-92ca-8f1d8c48feae None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.448663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 803/1638] 10.222.0.33 () {54 vars in 912 bytes} [Thu Sep 8 14:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:34.450162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf868ff-06a0-4d75-ad8d-bd58924d70aa None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.450862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf868ff-06a0-4d75-ad8d-bd58924d70aa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.451418 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf868ff-06a0-4d75-ad8d-bd58924d70aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.489221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2bf868ff-06a0-4d75-ad8d-bd58924d70aa None None] MFA Rules not processed for user `8767dbe845e14d569196fd38e5ea225b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:34.490748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2bf868ff-06a0-4d75-ad8d-bd58924d70aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:34.521716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 836/1639] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:34 2022] PUT /identity/v3/projects/79826e76995345f2adc9c6280b7f4f4b/users/a8de13c0eecb4be09c0963ada1ac093f/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:34.522609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.570897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 804/1640] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:34.572193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.572532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.572831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.595634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:34.597241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:34.630440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db7e-5ff3-4a39-9ade-9f7076951953 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.635819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.636759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.637122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.637773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] PATH_INFO: `/v3/projects/20b999d3e8194a96a42ff70bcb917de9/users/1fd63c6f3a754c0a88b3e117f1c60587/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.642358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b999d3e8194a96a42ff70bcb917de9, user_id=1fd63c6f3a754c0a88b3e117f1c60587, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.645391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.662507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 837/1641] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:34 2022] PUT /identity/v3/projects/20b999d3e8194a96a42ff70bcb917de9/users/1fd63c6f3a754c0a88b3e117f1c60587/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:34.662507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.730650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 805/1642] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:34.731626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.761290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f103b-59c5-449c-afe4-788b91141cc6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.768970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.769868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.770302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.770722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.774056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:34.776697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766fa3-7423-42d2-ad9b-4ceadc43bb06 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:34.788937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 838/1643] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:34.790985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.792005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.793588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.835693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] MFA Rules not processed for user `1fd63c6f3a754c0a88b3e117f1c60587`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:34.837727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:34.846798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e8ceb-b37c-42f3-8c8c-67e10097937b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.876530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:34.940157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.940815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.941103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.941633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:34.944972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 839/1644] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:34.945926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:34.959103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a3005-00ff-44bf-a113-1f55e2f0a532 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:34.964191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:34.964896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:34.965177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:34.965450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.017377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.018890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.030563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 806/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:35.031572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.043646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda66ff-04e7-4a68-85b7-d7c24a7c2f98 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.048614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.050345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e669cf-cd55-4ed6-8b90-acace74e785c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.060993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.064886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.064886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.064886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] PATH_INFO: `/v3/projects/79826e76995345f2adc9c6280b7f4f4b/users/a8de13c0eecb4be09c0963ada1ac093f/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.065342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79826e76995345f2adc9c6280b7f4f4b, user_id=a8de13c0eecb4be09c0963ada1ac093f, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.069322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.075625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 840/1646] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:35.084365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 807/1647] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:35 2022] PUT /identity/v3/projects/79826e76995345f2adc9c6280b7f4f4b/users/a8de13c0eecb4be09c0963ada1ac093f/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:35.095297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.095588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.095868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.100751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:35.113957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.137963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] MFA Rules not processed for user `a8de13c0eecb4be09c0963ada1ac093f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:35.139180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:35.181337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7034e2-8666-4560-95e6-6b35d8558c89 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.185501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.186248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.189063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.189063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.268799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 841/1648] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:35.286422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.326091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.329277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.344756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 808/1649] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:09:35.400293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76043ee-9b77-4982-bf52-9b364046bc22 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.406690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.407502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.407789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.408092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] PATH_INFO: `/v3/users/3aefc0ca2a654a26bbd0236e2a0ec6ce` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.410440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aefc0ca2a654a26bbd0236e2a0ec6ce)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.412193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.441420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.451685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73a8e-a1cc-4e36-883f-2fdb828a6620 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.457339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.457993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.458277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.458551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.471516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.473243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.506150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 809/1650] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:35.598893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:35.603988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.618574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe67c8-5c02-45ae-98ec-2fd808c1f1fd service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.631889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.631889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.631889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.631889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] PATH_INFO: `/v3/users/d7ed6f26234840ef84d877189870b2ec` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.632159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ed6f26234840ef84d877189870b2ec)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.632159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: WARNING py.warnings [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:35.632159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: warnings.warn(msg) Sep 08 14:09:35.632159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: Sep 08 14:09:35.633225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.683679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aefc0ca2a654a26bbd0236e2a0ec6ce'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:35.700358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:35.814094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aefc0ca2a654a26bbd0236e2a0ec6ce'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:35.819750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aefc0ca2a654a26bbd0236e2a0ec6ce'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:35.835692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aefc0ca2a654a26bbd0236e2a0ec6ce'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:35.843379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-67f784fb-9737-432b-8a27-966d559384d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aefc0ca2a654a26bbd0236e2a0ec6ce'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:35.851144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 842/1651] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:35 2022] DELETE /identity/v3/users/3aefc0ca2a654a26bbd0236e2a0ec6ce => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:09:35.861617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.861617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.861617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.879338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:35.881077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:35.973365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 843/1652] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:35.987839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.988919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:35.995373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ed6f26234840ef84d877189870b2ec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:36.066597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9789d41-76fa-4931-a739-ab05b5c62174 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:36.070569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:36.071289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:36.071645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:36.071996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:36.087211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:36.088660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:36.088905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ed6f26234840ef84d877189870b2ec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:36.089688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ed6f26234840ef84d877189870b2ec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:36.101278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 844/1653] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:36.108295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:36.108295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:36.108501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ed6f26234840ef84d877189870b2ec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:36.137455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-889f9588-7fee-4540-8cf8-1919f9f358bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ed6f26234840ef84d877189870b2ec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:36.144968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 810/1654] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:35 2022] DELETE /identity/v3/users/d7ed6f26234840ef84d877189870b2ec => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:09:36.151364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:36.151921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:36.152747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:36.176561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da860-f98b-448d-9ba3-9fb26c609f50 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:36.196290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:36.199733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:36.295628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:36.296266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:36.296695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:36.297286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:36.300334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:36.338325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:36.345270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 811/1655] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:36.357277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:36.358954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:36.401356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:36.402916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:36.428706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 845/1656] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:36.465109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813c138-4739-4748-bf83-49db45e7ca74 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:36.469946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:36.472626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:36.472626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:36.472626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:36.482702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:36.485030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:36.508919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 812/1657] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:36.641574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:37.618071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:37.621108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:37.696222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0007e8-d739-425f-9cfb-1aa7dcdd918d service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:37.723321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:37.730203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:37.730638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:37.730922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] PATH_INFO: `/v3/projects/d338a7f58c2744b1a69eb7c4ca70f3da` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:37.745666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d338a7f58c2744b1a69eb7c4ca70f3da)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:37.749034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:09:37.749034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Sep 08 14:09:37.749034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: Sep 08 14:09:37.757915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:37.856145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:37.857754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:37.894749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc392f-6e4d-4923-b488-35e13a5e3ae7 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:37.960722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd338a7f58c2744b1a69eb7c4ca70f3da', 'request_id': 'req-3f3b09df-13c3-4b55-8a78-675478689f2e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.058957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd338a7f58c2744b1a69eb7c4ca70f3da', 'request_id': 'req-3f3b09df-13c3-4b55-8a78-675478689f2e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.070714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd338a7f58c2744b1a69eb7c4ca70f3da', 'request_id': 'req-3f3b09df-13c3-4b55-8a78-675478689f2e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.087449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:38.089330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:38.089625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:38.091091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] PATH_INFO: `/v3/users/3aab0f8c0858441aa04feaf57e3e1496` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:38.092681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aab0f8c0858441aa04feaf57e3e1496)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:38.098289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:38.153246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] The token cache is being invalidate because project d338a7f58c2744b1a69eb7c4ca70f3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:38.155285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.160335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f3b09df-13c3-4b55-8a78-675478689f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.166077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 846/1658] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:37 2022] DELETE /identity/v3/projects/d338a7f58c2744b1a69eb7c4ca70f3da => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:38.174396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ff10-de2e-41d7-990b-57069f59a852 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:38.175248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ff10-de2e-41d7-990b-57069f59a852 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:38.176245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ff10-de2e-41d7-990b-57069f59a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:38.239096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0b92ff10-de2e-41d7-990b-57069f59a852 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:38.243207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b92ff10-de2e-41d7-990b-57069f59a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:38.268716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 847/1659] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:38.276883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:38.277190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:38.277437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:38.308031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:38.309361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:38.323638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 848/1660] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:38.325045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:38.336885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539763b-e3ed-4956-83f5-fc66c5cfb9fc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:38.343251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:38.344919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:38.345088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:38.345370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:38.346193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:38.347951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:38.350942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:38.366360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 849/1661] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:38.378186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:38.414735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aab0f8c0858441aa04feaf57e3e1496'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.424727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bac25e-aa6f-430c-898d-3c3b5065cb5d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:38.449532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:38.462585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:38.462585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:38.462585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:38.462585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:38.462585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:38.739741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aab0f8c0858441aa04feaf57e3e1496'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.740970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aab0f8c0858441aa04feaf57e3e1496'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.751890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aab0f8c0858441aa04feaf57e3e1496'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.831261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 850/1662] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:38 2022] POST /identity/v3/projects => generated 405 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:38.837735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:38.837885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aab0f8c0858441aa04feaf57e3e1496'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:38.838046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:38.849711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 813/1663] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:37 2022] DELETE /identity/v3/users/3aab0f8c0858441aa04feaf57e3e1496 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:38.850982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:38.852847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.008121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:39.015700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409e55-ad35-494f-b3ae-9763e0263836 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.019191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1119f-fe75-42dc-bd75-4240ad97ae22 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.028189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.029160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.030092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.033118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] PATH_INFO: `/v3/projects/4914f03913a848bd9c98eb25ab9a7aae` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.035294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.036198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4914f03913a848bd9c98eb25ab9a7aae)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.038559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.040584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.041047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.041473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.042918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.047173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f50d10-e028-4fa5-86e8-4b5b851c9c77 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.229788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 814/1664] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:38 2022] POST /identity/v3/users => generated 303 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:39.238180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.238180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.238180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.300465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:39.313317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.350773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4914f03913a848bd9c98eb25ab9a7aae', 'request_id': 'req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.461001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4914f03913a848bd9c98eb25ab9a7aae', 'request_id': 'req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.473375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4914f03913a848bd9c98eb25ab9a7aae', 'request_id': 'req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.485314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 815/1665] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:39.486169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:39.503938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] The token cache is being invalidate because project 4914f03913a848bd9c98eb25ab9a7aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:39.504237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.505148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.510597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 851/1666] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:38 2022] DELETE /identity/v3/projects/4914f03913a848bd9c98eb25ab9a7aae => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:39.514589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:39.516846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.519819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7174-0531-4b0d-86a3-f0a8ad36a836 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.532612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.538032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.538032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.538032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.538032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.538032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.549613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6cfd-521a-462d-9cec-fb862a9fc7b4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.565292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 816/1667] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:39.569599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:39.578690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.578690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.578690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.579104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:39.579296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] PATH_INFO: `/v3/users/1fd63c6f3a754c0a88b3e117f1c60587` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.579385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.582009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd63c6f3a754c0a88b3e117f1c60587)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.587183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.685946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7761e7-d705-4023-9a3c-438fb59415d8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.692158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.693479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.693868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.694220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.696231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.711954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.713900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.734840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 817/1668] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:39.736282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:39.739885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:39.773979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722a20-3174-4546-b591-e2d85b2b625f service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.796933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.797640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.797921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.798193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.798848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.800475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.859625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 818/1669] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:39.864086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:39.869862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd63c6f3a754c0a88b3e117f1c60587'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.898562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830adf6-f0a3-4e4d-ab13-40855bddd264 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:39.914846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:39.914846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:39.914846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:39.914846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] PATH_INFO: `/v3/projects/b65be352539c42a3897a556ccbe9ec3b/users/10637d6b4ea446c4ac28ca937b9c261e/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:39.956219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65be352539c42a3897a556ccbe9ec3b, user_id=10637d6b4ea446c4ac28ca937b9c261e, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:39.959176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:39.963060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd63c6f3a754c0a88b3e117f1c60587'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.964577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd63c6f3a754c0a88b3e117f1c60587'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:39.995434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd63c6f3a754c0a88b3e117f1c60587'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:40.002897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d8b18a31-756b-41c4-9200-66baa1068cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd63c6f3a754c0a88b3e117f1c60587'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:40.019173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 852/1670] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:39 2022] DELETE /identity/v3/users/1fd63c6f3a754c0a88b3e117f1c60587 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:09:40.139615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 819/1671] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:39 2022] PUT /identity/v3/projects/b65be352539c42a3897a556ccbe9ec3b/users/10637d6b4ea446c4ac28ca937b9c261e/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:40.147845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:40.152075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:40.154220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:40.197301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:40.206889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:40.412275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 853/1672] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:40.457785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:40.466077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:40.611678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564477f-dea4-41c3-9132-065f8bab3d27 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:40.621497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:40.621497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:40.621497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:40.621497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:40.640835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:40.642578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:40.655983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 820/1673] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:40.793211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:40.794976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:40.816672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f147a4-6304-4768-9e65-283ecda91caa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:40.830383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:40.831236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:40.831839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:40.831839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] PATH_INFO: `/v3/projects/94728edba1f94f6792948c4a0bd44845` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:40.835373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=94728edba1f94f6792948c4a0bd44845)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:40.837388 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:41.032773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94728edba1f94f6792948c4a0bd44845', 'request_id': 'req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:41.213490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94728edba1f94f6792948c4a0bd44845', 'request_id': 'req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:41.231374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94728edba1f94f6792948c4a0bd44845', 'request_id': 'req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:41.270660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] The token cache is being invalidate because project 94728edba1f94f6792948c4a0bd44845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:41.271024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:41.271739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:41.276468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 854/1674] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:40 2022] DELETE /identity/v3/projects/94728edba1f94f6792948c4a0bd44845 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:41.281496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:41.299221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c51ac-4e6a-40f1-a244-05c7e4713a5c service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:41.465315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:41.473266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:41.474981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:41.476107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] PATH_INFO: `/v3/users/8767dbe845e14d569196fd38e5ea225b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:41.479777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8767dbe845e14d569196fd38e5ea225b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:41.483106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:41.989255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8767dbe845e14d569196fd38e5ea225b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:42.117743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8767dbe845e14d569196fd38e5ea225b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:42.119101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8767dbe845e14d569196fd38e5ea225b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:42.131707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8767dbe845e14d569196fd38e5ea225b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:42.169584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-73184c5a-dd0d-4a63-81cc-73d62adff770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8767dbe845e14d569196fd38e5ea225b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:42.178208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 821/1675] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:41 2022] DELETE /identity/v3/users/8767dbe845e14d569196fd38e5ea225b => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:42.231453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:42.456808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:42.458607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:42.476852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a3fb2-3cb3-43f1-8770-ed2090194e2c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:42.674318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:42.675004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:42.675298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:42.677734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] PATH_INFO: `/v3/projects/20b999d3e8194a96a42ff70bcb917de9` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:42.681990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b999d3e8194a96a42ff70bcb917de9)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:42.689173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:43.005289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b999d3e8194a96a42ff70bcb917de9', 'request_id': 'req-509a7320-41a2-419d-9e3d-05f6faa1df6d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:43.163106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b999d3e8194a96a42ff70bcb917de9', 'request_id': 'req-509a7320-41a2-419d-9e3d-05f6faa1df6d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:43.173107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b999d3e8194a96a42ff70bcb917de9', 'request_id': 'req-509a7320-41a2-419d-9e3d-05f6faa1df6d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:43.195517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] The token cache is being invalidate because project 20b999d3e8194a96a42ff70bcb917de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:43.195770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:43.197391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-509a7320-41a2-419d-9e3d-05f6faa1df6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:43.203861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 855/1676] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:42 2022] DELETE /identity/v3/projects/20b999d3e8194a96a42ff70bcb917de9 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:43.206316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.207670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.218014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:43.218014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.277588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:43.278842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.455230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 822/1677] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:43.464471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.465326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.465872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.514576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:43.521256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.560167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 856/1678] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:43.561565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:43.584854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4c18-a33b-4464-973f-7d3d4a8964cb None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:43.599797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:43.600023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.600328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.600553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.601220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:43.601542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:43.603240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:43.632704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 823/1679] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:09:43.635507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:43.655432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877047c-8177-4f5b-9063-7ff96c0b6ebf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:43.680250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:43.680937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.681227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.681525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.682156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:43.688626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:43.916551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:43.917808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 857/1680] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:43 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:43.956773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed162-18b0-45fc-a6cc-d1fc9a1da07c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:44.243034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:44.243987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.247117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.248847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:44.250746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:44.268608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:44.371394 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:44.373987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:44.389284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 824/1681] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:43 2022] POST /identity/v3/users => generated 297 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:09:44.394705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:44.410779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf62ef-f353-4a3a-b5b9-959c6a2c0bae admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:44.426235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:44.427552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.429566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.430541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] PATH_INFO: `/v3/projects/69e730f2e45646188810324bb304b5b2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:44.439518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e730f2e45646188810324bb304b5b2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:44.445130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63219-c0e6-449e-b234-8e0a53844044 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:44.449989 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:44.468776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:44.474007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.478484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.478484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:44.478484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:44.486883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:44.538925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 825/1682] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:44.550576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:44.569655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba91b9-5250-4ab6-8a36-2db25db653ec admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:44.611082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:44.621576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.621576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.621576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:44.621576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:44.621576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0a764-c513-4987-a30f-5609a412f840 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:44.663997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e730f2e45646188810324bb304b5b2', 'request_id': 'req-28448955-a641-4da8-b8c3-d06627fc2a0d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:44.666215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 826/1683] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:44.669570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383078a-1eab-4abc-ab28-58b156875f6e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.676429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383078a-1eab-4abc-ab28-58b156875f6e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.676429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383078a-1eab-4abc-ab28-58b156875f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:44.786660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c383078a-1eab-4abc-ab28-58b156875f6e None None] MFA Rules not processed for user `10637d6b4ea446c4ac28ca937b9c261e`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:44.787946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c383078a-1eab-4abc-ab28-58b156875f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:44.831320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e730f2e45646188810324bb304b5b2', 'request_id': 'req-28448955-a641-4da8-b8c3-d06627fc2a0d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:44.839840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e730f2e45646188810324bb304b5b2', 'request_id': 'req-28448955-a641-4da8-b8c3-d06627fc2a0d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:44.882713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] The token cache is being invalidate because project 69e730f2e45646188810324bb304b5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:44.883207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:44.884310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:44.891076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 858/1684] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:44 2022] DELETE /identity/v3/projects/69e730f2e45646188810324bb304b5b2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:09:44.892577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:44.894278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:44.996765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 827/1685] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:44.996765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:44.997528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:44.997528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.041744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448955-a641-4da8-b8c3-d06627fc2a0d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.048453 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.049295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.049718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.050088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] PATH_INFO: `/v3/projects/770934c93e9d4cd89066f658832df7e2/users/2aa1773d781943799abfa5c812193899/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.065335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:45.066795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:45.072183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=770934c93e9d4cd89066f658832df7e2, user_id=2aa1773d781943799abfa5c812193899, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.075561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7e8cb-2cdc-4368-95a4-65fd78e1e35a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.104935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 828/1686] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:45.106033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:45.115007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:45.148962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809afc72-42d9-4027-8921-f0b62ef628c0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.166000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.166000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.166000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.166000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.166403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.167982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0623a4-0ec9-4dbb-8164-5e1324d64651 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.227819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 859/1687] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:44 2022] PUT /identity/v3/projects/770934c93e9d4cd89066f658832df7e2/users/2aa1773d781943799abfa5c812193899/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:45.229373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.229744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.230075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.296411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:45.298576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:45.366740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 829/1688] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:45.369128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.374344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.374912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.488726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] MFA Rules not processed for user `2aa1773d781943799abfa5c812193899`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:45.490645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 860/1689] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:45.493872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:45.494632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:45.519385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d521a-7c23-4586-90f7-4eb8f3343878 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.643525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:45.653607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 830/1690] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:45.656394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:45.675404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.676729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.676729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.676729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.680795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.684635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.736224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:45.762135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f6c72-19be-435b-829c-9ddee44c627c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.780947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.782068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.782466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.782979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.783776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:45.784606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.786215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.802586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 831/1691] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:45.803711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:45.816252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 861/1692] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/users => generated 309 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:45.818662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:45.845365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ad2f-347b-4d69-a575-f177f77e316c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.851980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.853434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.853857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.854399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.855354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6a55e-2a41-4f1e-8efe-0d9320cdbb75 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:45.855485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.857658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.872746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:45.873438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:45.873904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:45.876583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:45.877011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:45.884108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:45.962709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 832/1693] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:45.970821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.064476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 862/1694] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:45 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:46.066862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.111681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467ff23-7d62-48c5-84ec-755511dd8ad6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.225204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abe94-87e2-4e37-b7f9-9b4090441234 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.237143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.239761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.240500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.242317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.243229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.248029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.261182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.262790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.269238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.269697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.270542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.272388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.298083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 833/1695] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:46.300110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.333609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccca81a-85bd-490b-a69b-a6e3ab7f4d30 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.354336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.354981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.355267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.355548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.356265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.358244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.395872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 863/1696] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:46 2022] POST /identity/v3/users => generated 303 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:46.397708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.422304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b90f-2b8a-4a86-9cc1-97098ba37103 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.427456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.428144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.428471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.428773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] PATH_INFO: `/v3/projects/1bb09eadac99429299eb0c461059b3d9/users/55006f1302f545e7bc8c45cbfee06d3a/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.465614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb09eadac99429299eb0c461059b3d9, user_id=55006f1302f545e7bc8c45cbfee06d3a, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.472679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.490150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 834/1697] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:46 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:46.494054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.522285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c06c0-91fe-4a1b-bdc5-e197be1316e5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.527332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.528145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.529045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.529510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.530148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.532163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334d97e-2ca6-44ce-b942-24188da90ba4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.548051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 835/1698] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:46.550529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.551289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.552310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.614556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] MFA Rules not processed for user `dcb0911fad8c4d20ab2e832afd6bc51f`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:46.617422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:46.622654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 864/1699] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:46 2022] PUT /identity/v3/projects/1bb09eadac99429299eb0c461059b3d9/users/55006f1302f545e7bc8c45cbfee06d3a/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:46.624498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.812248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 836/1700] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:46.812556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a01df-b105-4fb0-9863-e3b736d312f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.813124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.824847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.826924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.828136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.829123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.838894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.838894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.849795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9723-562d-4488-a592-6967d9571c80 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.869668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.870438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.870630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.871152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] PATH_INFO: `/v3/projects/f5127775ea344523ae0dd273dda9c2c5/users/56382a4d85954d0081027df540be899e/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.871573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 865/1701] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:46.879143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.892549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186b0d-8cf4-4de5-86e6-6c857aa4f59c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:46.899138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:46.899849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:46.900408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:46.900578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:46.901298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.913854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.914166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5127775ea344523ae0dd273dda9c2c5, user_id=56382a4d85954d0081027df540be899e, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:46.914166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:46.919784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 866/1702] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:46.919784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:46.921007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:47.268529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac48275-2ccc-4443-9656-499571fd11fd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.268529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.268529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.268529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.276674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.276674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.276674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.278345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 837/1703] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:46 2022] PUT /identity/v3/projects/f5127775ea344523ae0dd273dda9c2c5/users/56382a4d85954d0081027df540be899e/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:47.278345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.278617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 867/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:47.278617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.278617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee15e2-1758-490f-a931-cd707ec4bdc7 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.364284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ecd55-444f-49af-9c39-07339b52a79d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.377624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.378656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.379105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.379584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.380465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.384762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.398512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 838/1705] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:47.399539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.417017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096901d-3cec-4325-8a14-a8947432937f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.424013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.425164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.425775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.426217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.427062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.429104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.444671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 839/1706] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:47.447969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.469123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db98dc-1593-4806-8056-fcf5d6b2b3ba admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.476126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.477300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.477766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.478392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] PATH_INFO: `/v3/projects/48fbcc13c2cf4ca0ae869dddd05a95e8/users/dc43348ed3c64e409b4bbd124a46b512/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.504340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fbcc13c2cf4ca0ae869dddd05a95e8, user_id=dc43348ed3c64e409b4bbd124a46b512, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.505091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.505495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.505783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.506065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] PATH_INFO: `/v3/projects/1bb09eadac99429299eb0c461059b3d9/users/55006f1302f545e7bc8c45cbfee06d3a/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.509507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac472d0-87c5-4e02-b6e2-10bdc9493cce admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.514433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb09eadac99429299eb0c461059b3d9, user_id=55006f1302f545e7bc8c45cbfee06d3a, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.517417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.535186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 868/1707] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:47 2022] PUT /identity/v3/projects/1bb09eadac99429299eb0c461059b3d9/users/55006f1302f545e7bc8c45cbfee06d3a/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:47.539017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.655274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 840/1708] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:47 2022] PUT /identity/v3/projects/48fbcc13c2cf4ca0ae869dddd05a95e8/users/dc43348ed3c64e409b4bbd124a46b512/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:47.667328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a59-474f-4315-b269-ac690f15f9b6 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.668088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a59-474f-4315-b269-ac690f15f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.668382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad3a59-474f-4315-b269-ac690f15f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.683937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b4c5-aabe-42d8-acd7-1a71f874ef56 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:47.763574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-30ad3a59-474f-4315-b269-ac690f15f9b6 None None] MFA Rules not processed for user `dc43348ed3c64e409b4bbd124a46b512`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:47.765105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-30ad3a59-474f-4315-b269-ac690f15f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:47.867826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:47.872240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.872240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.872240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] PATH_INFO: `/v3/projects/f5127775ea344523ae0dd273dda9c2c5/users/56382a4d85954d0081027df540be899e/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:47.877409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5127775ea344523ae0dd273dda9c2c5, user_id=56382a4d85954d0081027df540be899e, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:47.881315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:47.931470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 869/1709] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:47 2022] PUT /identity/v3/projects/f5127775ea344523ae0dd273dda9c2c5/users/56382a4d85954d0081027df540be899e/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:47.932597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:47.949005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:47.988066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 841/1710] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:47.996905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:47.997203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:47.997485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:48.126629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] MFA Rules not processed for user `56382a4d85954d0081027df540be899e`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:48.129578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:48.164675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24928c13-25ba-4f30-970f-a1fb70823b47 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:48.177454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:48.178132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:48.178413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:48.179040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] PATH_INFO: `/v3/users/6815cf65c74d4a009faf12abfd8e046c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:48.180595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6815cf65c74d4a009faf12abfd8e046c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:48.182608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:48.339666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 842/1711] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:48.341333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:48.371834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd957a-2940-4b01-a9dc-89a8c271f80e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:48.389864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:48.391349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:48.391770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:48.392151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:48.398860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:48.406626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f8e4-791e-4d9d-bc96-2be9c42c611f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:48.509335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6815cf65c74d4a009faf12abfd8e046c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:48.666971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 843/1712] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:48 2022] POST /identity/v3/projects => generated 367 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:48.669319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:48.669786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:48.670277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:48.683201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6815cf65c74d4a009faf12abfd8e046c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:48.685723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6815cf65c74d4a009faf12abfd8e046c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:48.714481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6815cf65c74d4a009faf12abfd8e046c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:48.744041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6815cf65c74d4a009faf12abfd8e046c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:48.745531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] MFA Rules not processed for user `de5e483e3a234f539f4f00170a282885`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:48.748876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:48.755328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 870/1713] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:47 2022] DELETE /identity/v3/users/6815cf65c74d4a009faf12abfd8e046c => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:48.756280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:48.758317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:48.923543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 844/1714] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:48.925455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:48.933634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:48.989981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:49.021624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5c84-0d46-4b28-a8ba-009cfd7b1a9c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.026265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.027026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.027412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.027860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.031683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.060320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:49.179002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.180740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875be41-3019-4e39-aa66-1d6e58bef0e6 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.198102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 871/1715] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:49.215793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3c13-3b2a-473a-bbc2-4767871c6912 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.216931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c2ec2-8248-4e2d-9827-c11bd2ba8fc2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.217373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3c13-3b2a-473a-bbc2-4767871c6912 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.219084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3c13-3b2a-473a-bbc2-4767871c6912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.257509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.257509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.257509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.257509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.257780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.257780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442e52-cb76-47de-98b3-d898ae0cffde admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.273747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c6cb3c13-3b2a-473a-bbc2-4767871c6912 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:49.276302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c6cb3c13-3b2a-473a-bbc2-4767871c6912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.317066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 872/1716] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:49.318595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.321039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.321529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.371863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] MFA Rules not processed for user `de5e483e3a234f539f4f00170a282885`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:49.373108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.376317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 845/1717] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:48 2022] POST /identity/v3/users => generated 290 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:49.377781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.378191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.378480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.392585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 873/1718] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:49.393476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.406785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.464565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] MFA Rules not processed for user `4e2982e7cf254d408ebadaa62555b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:49.466010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.498091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e396b-542e-450d-a244-b8d6dd37859a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.505749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.506795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.513174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.513610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.534859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.538558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.554687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 846/1719] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:49.562527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.566974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 874/1720] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:49.567720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.607196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48e380-cc9c-4b95-ba7a-46952c358190 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.620847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05d2c-cf3f-433f-ad83-d7cfd397c6ad service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.621016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.621016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.621016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.621016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.626282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.634970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.636413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.637085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.639230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.641628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.643514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.665746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 875/1721] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:49.669816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.677210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.754332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.756031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca17b-770f-4337-a6f5-8b048ee07819 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.767749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 847/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:49.769417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.775382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.775382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.798694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] MFA Rules not processed for user `4e2982e7cf254d408ebadaa62555b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:49.800748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.815198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 848/1723] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:49.819125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.821709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55544-c151-4215-ac79-cdae94c3d3b4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.836346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.836990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.836990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.837178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.854353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a27817-e304-4954-b2eb-d3a1b94cb176 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.863943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:49.875109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:49.875109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:49.875109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] PATH_INFO: `/v3/projects/294b468250774bd6a5438fda3577e3ec/users/5cb9a88b67cb48c18819f8ede0f73c10/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:49.875543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.875543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.900589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=294b468250774bd6a5438fda3577e3ec, user_id=5cb9a88b67cb48c18819f8ede0f73c10, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:49.903677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:49.911738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 876/1724] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:49.917780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:49.928327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:49.982638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d412038-73ed-49c5-97ec-8ac9b25f025d service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:49.989941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 849/1725] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:49 2022] PUT /identity/v3/projects/294b468250774bd6a5438fda3577e3ec/users/5cb9a88b67cb48c18819f8ede0f73c10/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:49.990885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:50.173988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:50.174906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17bed-4eb2-4751-8e7b-7c556d5c5bea admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:50.175491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.176229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.176899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:50.191808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:50.192384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.192753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.193041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:50.193698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:50.195326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172d58e-1bd2-43b8-88db-5b43eef9eb59 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:50.221702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 850/1726] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:50.223179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.225669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.225979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:50.266849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:50.269797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:50.292397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 877/1727] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:50.293933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:50.318278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] MFA Rules not processed for user `55006f1302f545e7bc8c45cbfee06d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:50.322143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbd9e-1a41-4522-944e-85a4aa324089 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:50.326778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:50.330865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:50.331909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.332404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.333182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] PATH_INFO: `/v3/projects/294b468250774bd6a5438fda3577e3ec/users/5cb9a88b67cb48c18819f8ede0f73c10/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:50.337028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=294b468250774bd6a5438fda3577e3ec, user_id=5cb9a88b67cb48c18819f8ede0f73c10, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:50.341441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c47a3-ef05-452e-930b-16008617edaa admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:50.370636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 878/1728] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:50 2022] PUT /identity/v3/projects/294b468250774bd6a5438fda3577e3ec/users/5cb9a88b67cb48c18819f8ede0f73c10/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:50.393873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.394545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.394902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:50.493879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] MFA Rules not processed for user `5cb9a88b67cb48c18819f8ede0f73c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:50.497217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:50.565582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 851/1729] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:50.701197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 879/1730] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:50.723208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:50.824587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:50.825774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:50.828660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:50.858401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ce46-fca5-46ff-b842-e70fe6761695 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:50.970822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:50.971541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:50.971939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:50.972285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.000376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.002843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab032def-8818-40f1-9a4d-b374a52085af service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.018191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32746ad7-752e-45f5-876f-d52f4a277a2c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.024741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.025471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.025763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.026041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] PATH_INFO: `/v3/projects/2960953ab9db4018961d503506c2d42c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.027410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2960953ab9db4018961d503506c2d42c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.028447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 852/1731] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:51.030502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.034760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3b22-5047-4330-8c4f-218a1ee9a8b0 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.035056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3b22-5047-4330-8c4f-218a1ee9a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.035949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3b22-5047-4330-8c4f-218a1ee9a8b0 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.037668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 853/1732] 10.222.0.33 () {54 vars in 912 bytes} [Thu Sep 8 14:09:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:51.047773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2e6-720b-4eb4-aeb4-172a9bfa6332 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.052164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2e6-720b-4eb4-aeb4-172a9bfa6332 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.052707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348b2e6-720b-4eb4-aeb4-172a9bfa6332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.148131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a348b2e6-720b-4eb4-aeb4-172a9bfa6332 None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:51.149628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a348b2e6-720b-4eb4-aeb4-172a9bfa6332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.241846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2960953ab9db4018961d503506c2d42c', 'request_id': 'req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:51.243871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 854/1733] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:51.245672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.246795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.247399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.255248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 855/1734] 10.222.0.33 () {54 vars in 912 bytes} [Thu Sep 8 14:09:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:51.265907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:51.268127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.343018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2960953ab9db4018961d503506c2d42c', 'request_id': 'req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:51.358558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2960953ab9db4018961d503506c2d42c', 'request_id': 'req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:51.377571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415d5f7-fa36-4ee9-b958-451435f415eb None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.378547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] The token cache is being invalidate because project 2960953ab9db4018961d503506c2d42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:51.378851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:51.380927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7d71f8ac-97b1-4fc0-bf56-bcf60eb054e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:51.387347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.387984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.388818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.389001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 880/1735] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:50 2022] DELETE /identity/v3/projects/2960953ab9db4018961d503506c2d42c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:09:51.389346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.392917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.394231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea03bf-f4fa-4683-8f9d-1ce462e9de43 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.394527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea03bf-f4fa-4683-8f9d-1ce462e9de43 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.394944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea03bf-f4fa-4683-8f9d-1ce462e9de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.472174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:51.476990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d3ea03bf-f4fa-4683-8f9d-1ce462e9de43 None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:51.478660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d3ea03bf-f4fa-4683-8f9d-1ce462e9de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.553559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.559170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.598461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 856/1736] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:51.600087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:51.602895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.635177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 881/1737] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:51.637021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937fa2-d76a-45da-bc0f-a78967af16dc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.637397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937fa2-d76a-45da-bc0f-a78967af16dc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.637944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937fa2-d76a-45da-bc0f-a78967af16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.650181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd08b73-9ecd-4b67-a434-3388c245d358 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.660110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.661790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.665748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.665748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.665948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3e937fa2-d76a-45da-bc0f-a78967af16dc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:51.667253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e937fa2-d76a-45da-bc0f-a78967af16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.668747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.694490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.697270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.726596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 857/1738] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:51.727693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:51.765501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb794fd-1269-421c-9f09-7c0f25fabd30 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.775556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.776615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.778210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.779252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.800744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.804967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.813069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 882/1739] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:51.821083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.821510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.821919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.838114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 858/1740] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:51.849767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:51.852303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:51.877592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 883/1741] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:09:51.878996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:51.913805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01d49c-7c68-4ea1-bc04-840733f3d184 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.935739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.937553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:51.937866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:51.938129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:51.938798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:51.939102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:51.944341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:51.969171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 859/1742] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:09:51.973784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:51.988927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a806ba-0304-4aa1-abd6-701feafafbee None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:51.998386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:51.998856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.003485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.003485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.003485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:52.006570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f84ae-0bf9-440c-a088-a4badf928276 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:52.180211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:52.192787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 884/1743] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:51 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:09:52.198287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:52.216400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9ad93-652f-4026-90c6-5f37de42bd58 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:52.392653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:52.394305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.394764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.395089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.396738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:52.398923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b114e1f-a4be-4d53-9b9f-5d0a8dacc8f7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:52.560984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b046-057a-4ddb-8068-624332dd97cf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.561534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b046-057a-4ddb-8068-624332dd97cf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.561534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5b046-057a-4ddb-8068-624332dd97cf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.563955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 885/1744] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:09:52.589970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 860/1745] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:52 2022] POST /identity/v3/users => generated 287 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:52.595367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5b046-057a-4ddb-8068-624332dd97cf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:52.601008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9db5c-2b0c-49ca-8282-e75ab3ce3f20 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.609244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9db5c-2b0c-49ca-8282-e75ab3ce3f20 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.609664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9db5c-2b0c-49ca-8282-e75ab3ce3f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.615877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5b046-057a-4ddb-8068-624332dd97cf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:52.619828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:52.620763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.621196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.621621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.622452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:52.624649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:52.640876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 886/1746] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:52.645099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:52.667775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04151c-dba1-40e7-a53a-3e9ba576b9eb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:52.678030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:52.679042 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.679528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.680003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.680961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:52.681546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-71b9db5c-2b0c-49ca-8282-e75ab3ce3f20 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:52.683120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71b9db5c-2b0c-49ca-8282-e75ab3ce3f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:52.683866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:52.697054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 887/1747] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:09:52.707938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:52.743924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fc3d-8f76-4c0a-8650-b677b3081103 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:52.799311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:52.800348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.803009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.803523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] PATH_INFO: `/v3/projects/bdd490aad2b94c81b787672ff6b0cf5b/users/7c66658a481f40d5b32f996794ec7d3b/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:52.847691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd490aad2b94c81b787672ff6b0cf5b, user_id=7c66658a481f40d5b32f996794ec7d3b, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:52.859809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b8ede-1fe8-4fed-ad67-d882aac8a08e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:52.965471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 888/1748] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:52 2022] PUT /identity/v3/projects/bdd490aad2b94c81b787672ff6b0cf5b/users/7c66658a481f40d5b32f996794ec7d3b/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:52.967077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:52.967371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:52.967650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:53.001952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 861/1749] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:53.005517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:53.005926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:53.006222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:53.070365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] MFA Rules not processed for user `dcb0911fad8c4d20ab2e832afd6bc51f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:53.072990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:53.118916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] MFA Rules not processed for user `7c66658a481f40d5b32f996794ec7d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:53.120391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:53.286926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 889/1750] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:53.299533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:53.324583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:53.326300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:53.331240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 862/1751] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:53.336410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:53.493028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d26874-be7e-446a-8285-22f390e6ba35 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:53.501384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:53.502440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:53.502901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:53.503963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:53.505691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:53.509410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:53.590375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d49fb-03dd-44fe-971b-aa6107a7e665 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:53.611687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:53.612340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:53.613020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:53.613373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:53.635834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:53.637643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:53.662101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 890/1752] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:53.674531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 863/1753] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:53 2022] POST /identity/v3/projects => generated 373 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:53.678820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:53.730760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95760c6-b4e6-43e6-8caf-3dbedf17db68 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:53.854337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:53.861288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:53.862025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:53.864165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:53.866491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:53.871547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.065824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 891/1754] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:09:53 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:09:54.073619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:54.095855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666891e-3f29-4fef-9461-be9e7098e66a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:54.127210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:54.127210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.131030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.131030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.139118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:54.143369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.209594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 864/1755] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:54.210810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:54.230279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c427574-59ee-49dd-83ed-531596555264 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:54.275296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:54.287741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:54.287741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.287741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.288015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] PATH_INFO: `/v3/projects/dcaedb51ae49455dab84f4566b66d59d/users/60f12698cccc44fb9a7758503d7f569d/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.359928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaedb51ae49455dab84f4566b66d59d, user_id=60f12698cccc44fb9a7758503d7f569d, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:54.369901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800ba6f-7193-423e-843f-c79fd935e8be admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.473089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:54.495082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 892/1756] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:54 2022] PUT /identity/v3/projects/dcaedb51ae49455dab84f4566b66d59d/users/60f12698cccc44fb9a7758503d7f569d/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:54.497347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e227a-77ae-48ed-94e2-3687fff57207 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:54.506883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed623-b117-4eb6-a99b-588964ed0c75 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.507542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed623-b117-4eb6-a99b-588964ed0c75 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.508266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed623-b117-4eb6-a99b-588964ed0c75 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.509991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 893/1757] 10.222.0.33 () {54 vars in 961 bytes} [Thu Sep 8 14:09:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:54.514754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed623-b117-4eb6-a99b-588964ed0c75 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:54.669258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:54.672497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.672995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.673407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.678979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:54.710973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:54.716153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb0416-9cb4-4a37-8dc2-fdc2edb36fc9 service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.760630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 865/1758] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:54.761914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66c83-4e76-4a9c-9ca2-2521346a5e66 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.762212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66c83-4e76-4a9c-9ca2-2521346a5e66 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.762494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f66c83-4e76-4a9c-9ca2-2521346a5e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.792970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aed623-b117-4eb6-a99b-588964ed0c75 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:54.806218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:54.806868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.807157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.807493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.808161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:54.812560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.817145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-23f66c83-4e76-4a9c-9ca2-2521346a5e66 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:54.818397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-23f66c83-4e76-4a9c-9ca2-2521346a5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:54.846039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 866/1759] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Sep 8 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:54.846039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949137e7-7883-43b4-a860-89aded27f871 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.846039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949137e7-7883-43b4-a860-89aded27f871 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.846039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949137e7-7883-43b4-a860-89aded27f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.856398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 894/1760] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:09:54.857410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:54.898752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-949137e7-7883-43b4-a860-89aded27f871 None None] MFA Rules not processed for user `4e2982e7cf254d408ebadaa62555b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:54.899343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27701735-ffa0-4c3e-be4a-6359031d8f89 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:54.900050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-949137e7-7883-43b4-a860-89aded27f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:54.921618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:54.922344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:54.922637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:54.922920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:54.956437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:54.958080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:54.993974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 895/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:54.993974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:55.043726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 867/1762] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:55.044158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5c5fa-2f30-4654-ae5c-0cbbd8386745 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:55.073438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:55.075524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:55.076035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:55.076630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] PATH_INFO: `/v3/projects/dcaedb51ae49455dab84f4566b66d59d/users/60f12698cccc44fb9a7758503d7f569d/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:55.080620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaedb51ae49455dab84f4566b66d59d, user_id=60f12698cccc44fb9a7758503d7f569d, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:55.084628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d351bfe-5390-4051-a7b6-046b6b0fc771 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:55.132329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 896/1763] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:09:54 2022] PUT /identity/v3/projects/dcaedb51ae49455dab84f4566b66d59d/users/60f12698cccc44fb9a7758503d7f569d/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:55.137991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:55.139638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:55.140645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:55.223371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] MFA Rules not processed for user `60f12698cccc44fb9a7758503d7f569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:55.225419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:55.385371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca13bd-80dd-4e3d-a5fb-fa78f8fec2b2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:55.386050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca13bd-80dd-4e3d-a5fb-fa78f8fec2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:55.394333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca13bd-80dd-4e3d-a5fb-fa78f8fec2b2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:55.394333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 897/1764] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:09:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:09:55.397182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 868/1765] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:55.415759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:55.415881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:55.416462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:55.514010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] MFA Rules not processed for user `ebc702da0b654042a0f5526ea47ef536`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:55.516737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:55.643082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:55.644974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:55.792423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 898/1766] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:55.805755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebb79-9293-49ae-9882-96b0f08bd6bd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:55.822648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:55.823962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:55.824916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:55.825715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:55.859795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:55.863688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:55.889507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 869/1767] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:56.040860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:56.041735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:56.151781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e69a27-3d24-4b17-a466-81fd0db53388 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:56.159134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:56.165198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:56.167242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:56.167732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:56.172592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] PATH_INFO: `/v3/users/10637d6b4ea446c4ac28ca937b9c261e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:56.179025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10637d6b4ea446c4ac28ca937b9c261e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:56.182275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:56.522426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10637d6b4ea446c4ac28ca937b9c261e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:56.592676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:56.609363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3630-3711-4493-9a33-3a19327269ff service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:56.623932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:56.623932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:56.623932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:56.623932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:56.639346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:56.649110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10637d6b4ea446c4ac28ca937b9c261e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:56.650424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10637d6b4ea446c4ac28ca937b9c261e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:56.654700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:56.680027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10637d6b4ea446c4ac28ca937b9c261e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:56.686265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 870/1768] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:09:56.709905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10637d6b4ea446c4ac28ca937b9c261e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:56.734846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 899/1769] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:56 2022] DELETE /identity/v3/users/10637d6b4ea446c4ac28ca937b9c261e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:56.814503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:56.816140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:56.856921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396089-3a4a-4258-80b6-899defc4fa5a service placement] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:57.067001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:57.067767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:57.069514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:57.070697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:57.074146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:57.233054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:57.235095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:57.245860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 871/1770] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:57.294876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:57.297690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:57.449986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd349d-9039-45ae-9490-5ec8fb2709b2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:57.457169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:57.458123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:57.461438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:57.461438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] PATH_INFO: `/v3/projects/b65be352539c42a3897a556ccbe9ec3b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:57.461438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65be352539c42a3897a556ccbe9ec3b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:57.464221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:57.843917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65be352539c42a3897a556ccbe9ec3b', 'request_id': 'req-aa7ccc0c-b661-405b-ab69-b7bff63255cb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:57.915999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:57.990004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65be352539c42a3897a556ccbe9ec3b', 'request_id': 'req-aa7ccc0c-b661-405b-ab69-b7bff63255cb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:57.998696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65be352539c42a3897a556ccbe9ec3b', 'request_id': 'req-aa7ccc0c-b661-405b-ab69-b7bff63255cb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.025501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] The token cache is being invalidate because project b65be352539c42a3897a556ccbe9ec3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:58.026349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.028044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.050390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 900/1771] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:57 2022] DELETE /identity/v3/projects/b65be352539c42a3897a556ccbe9ec3b => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:58.054440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:58.078134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9e16-00f6-4461-9cf8-eb38576a5276 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:58.170836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:58.172104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:58.172386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:58.172695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] PATH_INFO: `/v3/users/55006f1302f545e7bc8c45cbfee06d3a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:58.174111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55006f1302f545e7bc8c45cbfee06d3a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:58.176041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:58.421602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55006f1302f545e7bc8c45cbfee06d3a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.577604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55006f1302f545e7bc8c45cbfee06d3a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.577604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55006f1302f545e7bc8c45cbfee06d3a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.586535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55006f1302f545e7bc8c45cbfee06d3a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.623385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55006f1302f545e7bc8c45cbfee06d3a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:58.623385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 872/1772] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:58 2022] DELETE /identity/v3/users/55006f1302f545e7bc8c45cbfee06d3a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:59.006954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:59.006954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:59.029260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ccc0c-b661-405b-ab69-b7bff63255cb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:59.111932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036216-d130-4050-999d-f255208296bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:59.112679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036216-d130-4050-999d-f255208296bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.113134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036216-d130-4050-999d-f255208296bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.113560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036216-d130-4050-999d-f255208296bf admin admin] PATH_INFO: `/v3/projects/1bb09eadac99429299eb0c461059b3d9` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.115161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036216-d130-4050-999d-f255208296bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb09eadac99429299eb0c461059b3d9)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:59.117465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036216-d130-4050-999d-f255208296bf admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:59.331618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb09eadac99429299eb0c461059b3d9', 'request_id': 'req-ec036216-d130-4050-999d-f255208296bf'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:59.365715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:59.367434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:59.381228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf58223-f1c2-45fd-9e74-10a611e8f439 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:59.446436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:59.447093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.447376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.447664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] PATH_INFO: `/v3/users/2aa1773d781943799abfa5c812193899` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.448848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa1773d781943799abfa5c812193899)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:59.450787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:59.506805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb09eadac99429299eb0c461059b3d9', 'request_id': 'req-ec036216-d130-4050-999d-f255208296bf'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:59.516959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb09eadac99429299eb0c461059b3d9', 'request_id': 'req-ec036216-d130-4050-999d-f255208296bf'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:59.549617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] The token cache is being invalidate because project 1bb09eadac99429299eb0c461059b3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:09:59.550502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:59.552344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ec036216-d130-4050-999d-f255208296bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:09:59.565015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 901/1773] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:09:59 2022] DELETE /identity/v3/projects/1bb09eadac99429299eb0c461059b3d9 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:09:59.572078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1002b-894c-4890-bf3e-8b42404c07be None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.572705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1002b-894c-4890-bf3e-8b42404c07be None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.573280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1002b-894c-4890-bf3e-8b42404c07be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.616095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6bf1002b-894c-4890-bf3e-8b42404c07be None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:59.618054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6bf1002b-894c-4890-bf3e-8b42404c07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:59.633049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 902/1774] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:59.646064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.646896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.647381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.673504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:59.674222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:59.683692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 903/1775] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:59.694519 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:59.706532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146067f3-41f4-45ae-966b-aca4681a7d5f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:59.711688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:59.713701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.713701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.713701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.714529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:09:59.714835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:59.716449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:59.733750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 904/1776] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:09:59.735465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:59.746355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292fb5e-38bb-43cf-8db8-1d21d4ae6f54 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:59.752550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:59.753185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:59.753468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:59.753916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:59.754387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:59.756311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:59.788652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa1773d781943799abfa5c812193899'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:00.148389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 905/1777] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:09:59 2022] POST /identity/v3/projects => generated 401 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:00.153048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.224532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd50a4f-169f-4a17-8995-98a8eee3f593 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.229709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.230574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.230996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.231412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.231921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa1773d781943799abfa5c812193899'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:00.232603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:00.235127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa1773d781943799abfa5c812193899'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:00.235759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:00.248452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa1773d781943799abfa5c812193899'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:00.267957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4c5ad7e8-631b-42f5-b105-db74ce234711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa1773d781943799abfa5c812193899'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:00.279658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 873/1778] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:09:59 2022] DELETE /identity/v3/users/2aa1773d781943799abfa5c812193899 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:00.285290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.285713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.286244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.308588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:00.309839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:00.378053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 874/1779] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:00.398629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.400128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 906/1780] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:00 2022] POST /identity/v3/users => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:00.403836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:00.406280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.408320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:00.423977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf702f0-a4c6-4b3f-aec5-bbc755b6e644 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.431814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.433347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.433838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.434337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.435232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:00.438617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:00.450231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 907/1781] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:00.455121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.473369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e5b7d-4b58-4426-8c19-53b34d8cdd2d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.474923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cf8a-cefe-42e3-a667-c5b2bf6e1f8d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.478458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.478713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.479301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.479605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.480125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.480414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.480604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.481028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.482420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:00.485941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:00.494924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:00.496394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf5e0f-5bed-45c2-a81b-29d8c5c1cede service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:00.508815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 908/1782] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:00.514036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.521572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 875/1783] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:00.529693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a8a79-6ef4-4e93-99a2-277ea5d1c3af admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.535382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.536270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.536727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.537154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] PATH_INFO: `/v3/projects/a5f48cd666ba43dbafd7efff96341c9a/users/c36ca39f51d84f85b929835aeae73dd9/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.556064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f48cd666ba43dbafd7efff96341c9a, user_id=c36ca39f51d84f85b929835aeae73dd9, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:00.559353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:00.701512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 909/1784] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:00 2022] PUT /identity/v3/projects/a5f48cd666ba43dbafd7efff96341c9a/users/c36ca39f51d84f85b929835aeae73dd9/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:00.719387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:00.720791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.721342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.721622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.790459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] MFA Rules not processed for user `c36ca39f51d84f85b929835aeae73dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:00.793089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:00.877635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 876/1785] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:00.882994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:00.985938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7ed5-f2a3-46bc-9a7a-9225b1b7e0f3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:00.995494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:00.996879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:00.997327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:00.997696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:00.998513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:01.001533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:01.182925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 910/1786] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:00 2022] POST /identity/v3/projects => generated 399 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:01.187241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:01.200085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b72c1-fbe7-4f7c-a9e7-31759d198155 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:01.347225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:01.347865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:01.348150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:01.348430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:01.349142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:01.351100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:01.477997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:01.483842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:01.532168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a5cae-a85d-4ed3-bba8-e07f52a852ac admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:01.538044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:01.538684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:01.538941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:01.539218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] PATH_INFO: `/v3/projects/770934c93e9d4cd89066f658832df7e2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:01.540491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=770934c93e9d4cd89066f658832df7e2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:01.542446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:01.544699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 877/1787] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:01 2022] POST /identity/v3/users => generated 306 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:01.548908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:01.566401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb999a6b-90de-4a29-b3cc-fd6c34066bc7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:01.576950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:01.578513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:01.578982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:01.579441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:01.580450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:01.583395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:01.612381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 878/1788] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:01.616736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:01.628141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ec9e-41b3-46f9-ba1d-0a5e8aefb783 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:01.633373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:01.634208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:01.634520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:01.634824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] PATH_INFO: `/v3/projects/44b0c459ca1045e38aa293961b62af13/users/bda1add4889f4d25b92ac7c79a2422a5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:01.653436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b0c459ca1045e38aa293961b62af13, user_id=bda1add4889f4d25b92ac7c79a2422a5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:01.666014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057cac99-f4d1-4efb-989e-4efb441d97f8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:01.875196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 879/1789] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:01 2022] PUT /identity/v3/projects/44b0c459ca1045e38aa293961b62af13/users/bda1add4889f4d25b92ac7c79a2422a5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:01.875196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:01.879913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:01.880246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:01.895685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770934c93e9d4cd89066f658832df7e2', 'request_id': 'req-60be70df-d004-4512-9a7f-469669ad1f32'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.001540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:02.003329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:02.049712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770934c93e9d4cd89066f658832df7e2', 'request_id': 'req-60be70df-d004-4512-9a7f-469669ad1f32'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.063039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770934c93e9d4cd89066f658832df7e2', 'request_id': 'req-60be70df-d004-4512-9a7f-469669ad1f32'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.089797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] The token cache is being invalidate because project 770934c93e9d4cd89066f658832df7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:02.090104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.090802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.093483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 911/1790] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:01 2022] DELETE /identity/v3/projects/770934c93e9d4cd89066f658832df7e2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:02.094166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:02.095599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:02.109914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 880/1791] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:02.111092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:02.113573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:02.220398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4d60-3b97-44fb-8f8a-072f22870bf9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:02.223697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:02.224369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:02.224698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:02.224982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] PATH_INFO: `/v3/users/56382a4d85954d0081027df540be899e` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:02.226157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] RBAC: Authorizing `identity:delete_user(user_id=56382a4d85954d0081027df540be899e)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:02.228024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be70df-d004-4512-9a7f-469669ad1f32 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:02.228551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:02.235456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:02.236114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:02.236437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:02.236768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:02.237444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:02.239112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:02.252592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 912/1792] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:02.254384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:02.256952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:02.272593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972fe22-279a-437d-86a9-3b9f4158b139 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:02.278348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:02.279142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:02.279464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:02.279745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] PATH_INFO: `/v3/users/dc43348ed3c64e409b4bbd124a46b512` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:02.281105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc43348ed3c64e409b4bbd124a46b512)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:02.283464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:02.672565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:02.780938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56382a4d85954d0081027df540be899e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.804813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc43348ed3c64e409b4bbd124a46b512'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.931618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56382a4d85954d0081027df540be899e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.935711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56382a4d85954d0081027df540be899e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.957023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56382a4d85954d0081027df540be899e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.981809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56382a4d85954d0081027df540be899e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:02.989997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 881/1793] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:02 2022] DELETE /identity/v3/users/56382a4d85954d0081027df540be899e => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:02.990868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:02.992267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.026416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc43348ed3c64e409b4bbd124a46b512'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:03.027190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc43348ed3c64e409b4bbd124a46b512'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:03.058064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc43348ed3c64e409b4bbd124a46b512'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:03.072985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc43348ed3c64e409b4bbd124a46b512'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:03.087603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 913/1794] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:02 2022] DELETE /identity/v3/users/dc43348ed3c64e409b4bbd124a46b512 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:03.089084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:03.096636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.111295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85ff2-fc0b-472d-a6bd-3657114d18af admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:03.180452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:03.181386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.181755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.182034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] PATH_INFO: `/v3/projects/44b0c459ca1045e38aa293961b62af13/users/bda1add4889f4d25b92ac7c79a2422a5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.192690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b0c459ca1045e38aa293961b62af13, user_id=bda1add4889f4d25b92ac7c79a2422a5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:03.198225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333e09d-e640-4705-b702-3263076d8359 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:03.218942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90278570-26d7-44b9-8f91-8abf2432b4f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:03.220013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 882/1795] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:02 2022] PUT /identity/v3/projects/44b0c459ca1045e38aa293961b62af13/users/bda1add4889f4d25b92ac7c79a2422a5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:03.222850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc7823-2612-41f3-be44-1b3872c70a26 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.223204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc7823-2612-41f3-be44-1b3872c70a26 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.223550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc7823-2612-41f3-be44-1b3872c70a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.250181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a9dc7823-2612-41f3-be44-1b3872c70a26 None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:03.251717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a9dc7823-2612-41f3-be44-1b3872c70a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.324470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 883/1796] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Sep 8 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:03.328046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f1f-7b1a-429a-a50d-2b2ca9506e94 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.329039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f1f-7b1a-429a-a50d-2b2ca9506e94 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.335401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de803f1f-7b1a-429a-a50d-2b2ca9506e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.342366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:03.344276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.344785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.345838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.347997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.356121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-de803f1f-7b1a-429a-a50d-2b2ca9506e94 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:03.357780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-de803f1f-7b1a-429a-a50d-2b2ca9506e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.488096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 884/1797] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:03.489906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.490207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.490487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.492863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:03.502079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:03.523628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 914/1798] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:10:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:10:03.554414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] MFA Rules not processed for user `bda1add4889f4d25b92ac7c79a2422a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:03.559374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.572788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:03.574663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.612798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e75a18-13b4-4624-957a-acc1714e0123 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:03.637584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:03.641129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.642966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.645227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.686225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:03.687873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:03.729323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 915/1799] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:03.731424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:03.742249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.777050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e90-5f12-4cfe-980b-f656405fed6e service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:03.799176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:03.799835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:03.800130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:03.800404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:03.833148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:03.834730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:03.846120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 885/1800] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:03.860451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:03.861893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:03.882347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 916/1801] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:04.003356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9dc72-bd46-44fa-9558-9b8d04540a2a None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:04.016182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:04.018246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:04.019182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:04.019508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:04.049709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:04.055114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:04.098162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 886/1802] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:04.953952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:04.955849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:05.002510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d174ae-d85c-4193-88cf-975509b179b7 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:05.021023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:05.021865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:05.022332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:05.022818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] PATH_INFO: `/v3/projects/f5127775ea344523ae0dd273dda9c2c5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:05.024076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5127775ea344523ae0dd273dda9c2c5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:05.031275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:05.092675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:05.105529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15167cb-6566-4721-93f9-d6e5540a235b service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:05.117889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:05.119397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:05.119397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:05.119397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:05.126090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:05.307043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:05.309443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:05.409473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 887/1803] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:05 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:05.683777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5127775ea344523ae0dd273dda9c2c5', 'request_id': 'req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:05.934988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5127775ea344523ae0dd273dda9c2c5', 'request_id': 'req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:05.949395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:05.954382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:05.961866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5127775ea344523ae0dd273dda9c2c5', 'request_id': 'req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.028630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] The token cache is being invalidate because project f5127775ea344523ae0dd273dda9c2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:06.029432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.033142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748947a-0b0e-4ff2-ab9d-4246e35c87a4 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:06.036787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a68fc851-d03f-4592-8bf5-1b6e0ff3f905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.044396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 917/1804] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:04 2022] DELETE /identity/v3/projects/f5127775ea344523ae0dd273dda9c2c5 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:06.050246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e96d-0b83-4d07-8406-d71068f83846 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.051250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e96d-0b83-4d07-8406-d71068f83846 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.057791 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e96d-0b83-4d07-8406-d71068f83846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.098070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8051e96d-0b83-4d07-8406-d71068f83846 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:06.101062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8051e96d-0b83-4d07-8406-d71068f83846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:06.262907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:06.263579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.263883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.264145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] PATH_INFO: `/v3/projects/48fbcc13c2cf4ca0ae869dddd05a95e8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.267613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48fbcc13c2cf4ca0ae869dddd05a95e8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:06.269639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:06.292810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 918/1805] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:06.294353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.294648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.295069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.320589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:06.321896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:06.337722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 919/1806] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:06.349550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:06.350305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ca25a-1fcd-4903-9a3b-17e4528f400e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:06.355716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:06.356346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.356671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.356946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.357601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:06.358054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:06.359700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:06.377816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 920/1807] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:06.379511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:06.401443 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e589cc-ac11-4725-98d8-a0a89c0bf6bc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:06.416167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:06.416845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.417109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.417482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.418521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:06.422581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaf4cb-3b1b-440b-90b0-c09a39b84790 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:06.453940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fbcc13c2cf4ca0ae869dddd05a95e8', 'request_id': 'req-0f690709-dffd-4a34-9d40-acedca930e5e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.554706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 921/1808] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:06.560755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2830fcd-82ac-42a1-9359-df560d5d89f1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.560755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2830fcd-82ac-42a1-9359-df560d5d89f1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.560755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2830fcd-82ac-42a1-9359-df560d5d89f1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.568387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 922/1809] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:10:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:10:06.569374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2830fcd-82ac-42a1-9359-df560d5d89f1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:06.642999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fbcc13c2cf4ca0ae869dddd05a95e8', 'request_id': 'req-0f690709-dffd-4a34-9d40-acedca930e5e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.658313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fbcc13c2cf4ca0ae869dddd05a95e8', 'request_id': 'req-0f690709-dffd-4a34-9d40-acedca930e5e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.686886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] The token cache is being invalidate because project 48fbcc13c2cf4ca0ae869dddd05a95e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:06.687431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.690693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0f690709-dffd-4a34-9d40-acedca930e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:06.711098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 888/1810] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:05 2022] DELETE /identity/v3/projects/48fbcc13c2cf4ca0ae869dddd05a95e8 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:06.719619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.723218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.723730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.805964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:06.807273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:06.817310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2830fcd-82ac-42a1-9359-df560d5d89f1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:06.826575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:06.828739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:06.829597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:06.831104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:06.832111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:06.834820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:07.085024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 923/1811] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:06 2022] POST /identity/v3/users => generated 293 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:07.088279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:07.099682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:07.170700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c20ad-8f3d-4849-9d3e-21ffe2ad161f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:07.189264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:07.195035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:07.195035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:07.195035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] PATH_INFO: `/v3/users/5cb9a88b67cb48c18819f8ede0f73c10` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:07.195035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb9a88b67cb48c18819f8ede0f73c10)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:07.197064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:07.210886 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 889/1812] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:07.216598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:07.224205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:07.289231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5169c-448d-48c7-bf9b-1bf60d38d0e5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:07.317583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:07.318399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:07.319081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:07.321299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:07.322088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:07.323918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:07.381001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 890/1813] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:07.382280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:07.405408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218c25-7861-4ac5-8728-603251541132 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:07.425289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:07.426280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:07.426791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:07.427278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:07.428170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:07.430772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:07.457149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 891/1814] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:07.461676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:07.493285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16231aa-a1c1-4381-a083-3182f0d028b0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:07.510010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:07.510010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:07.510010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:07.510010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] PATH_INFO: `/v3/projects/88e8507cea2a46af8cd58221a1d5463d/users/470ccd0a014d4099a3365713bb5e3791/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:07.541414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e8507cea2a46af8cd58221a1d5463d, user_id=470ccd0a014d4099a3365713bb5e3791, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:07.544547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:07.657491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb9a88b67cb48c18819f8ede0f73c10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:07.781719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 892/1815] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:07 2022] PUT /identity/v3/projects/88e8507cea2a46af8cd58221a1d5463d/users/470ccd0a014d4099a3365713bb5e3791/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:07.783013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:07.785093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:07.804055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb9a88b67cb48c18819f8ede0f73c10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:07.806219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb9a88b67cb48c18819f8ede0f73c10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:07.831131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb9a88b67cb48c18819f8ede0f73c10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:07.846566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b5097fd8-90ab-426f-9d36-db0a74efdaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb9a88b67cb48c18819f8ede0f73c10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:07.864196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 924/1816] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:07 2022] DELETE /identity/v3/users/5cb9a88b67cb48c18819f8ede0f73c10 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:07.865716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72da-abe0-4eed-ad0f-5917acb19aef None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:07.866008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72da-abe0-4eed-ad0f-5917acb19aef None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:07.866286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72da-abe0-4eed-ad0f-5917acb19aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:07.990764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fbae72da-abe0-4eed-ad0f-5917acb19aef None None] MFA Rules not processed for user `470ccd0a014d4099a3365713bb5e3791`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:07.993520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fbae72da-abe0-4eed-ad0f-5917acb19aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:08.024944 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b20bd-f953-461f-ad07-c215c56657b8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:08.111881 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 925/1817] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:08.119502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:08.119899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:08.120195 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:08.130315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 926/1818] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:10:08 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:10:08.132332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:08.134390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:08.209017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:08.210964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:08.212135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:08.212435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:08.219150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:08.256130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:08.257680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa42aea-8b2c-4f16-bf62-d5d29f3604c8 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:08.318979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 893/1819] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:08.320469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:08.320784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:08.321067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:08.340142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:08.389252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:08.409867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:08.412299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ea24-a118-4d9f-9d4f-3949fd2c4557 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:08.418859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:08.441462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:08.441462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:08.441462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:08.441462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:08.442314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:08.442314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:08.453792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 894/1820] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:10:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:08.454991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:08.458381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:08.512630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f27681-832b-46b2-9cbb-7ed1d06a34e4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:08.523826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:08.524815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:08.527795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:08.527795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] PATH_INFO: `/v3/users/25a95e251a114dd7b5a427eb39f84aeb` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:08.527795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a95e251a114dd7b5a427eb39f84aeb)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:08.542690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:08.716324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 927/1821] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:08 2022] POST /identity/v3/projects => generated 387 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:08.717619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:08.721480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:09.015641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a95e251a114dd7b5a427eb39f84aeb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:09.056450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a9d37-27a7-4a82-86fe-8c0826aa1bb5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.072358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.073119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.073473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.073749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.092470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:09.092470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:09.123995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 928/1822] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:09.141056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:09.189197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a95e251a114dd7b5a427eb39f84aeb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:09.189839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a95e251a114dd7b5a427eb39f84aeb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:09.198998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a95e251a114dd7b5a427eb39f84aeb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:09.244226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcf804e8-cb11-4464-b3ab-1d014683b12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a95e251a114dd7b5a427eb39f84aeb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:09.258615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 895/1823] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:08 2022] DELETE /identity/v3/users/25a95e251a114dd7b5a427eb39f84aeb => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:09.270156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.270449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.270830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.346851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:09.352633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:09.373225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777a72-8730-4bc8-bfc5-c9efde007bce service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.511804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 896/1824] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:09.527336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.528338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.528812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.529224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.530020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:09.532560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:09.582100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:09.585823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:09.712091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 929/1825] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:09 2022] POST /identity/v3/users => generated 300 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:09.718335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:09.725909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:09.766355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c20ae-1010-4dc2-94be-e971ac21b92e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.787009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.788608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.789118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.789739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.790637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:09.793242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:09.827026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 930/1826] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:09.828254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:09.833415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:09.850223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811dcc-4caa-4e53-8f06-79ebd13b7e13 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.851094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d900e-5674-4214-8349-2534c7543964 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.857030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.860280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.860280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.860280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] PATH_INFO: `/v3/projects/294b468250774bd6a5438fda3577e3ec` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.860280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294b468250774bd6a5438fda3577e3ec)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:09.862403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:09.870174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.871078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.871368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.872050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:09.900073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:09.903305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:09.939075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 897/1827] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:09.940228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:09.951261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2acaac-0556-476b-83f1-d221d942e66f service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:09.957976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:09.958957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:09.959433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:09.959894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] PATH_INFO: `/v3/projects/33510eacdc5242f2a60fe36cfdfa2610/users/c391d5c71f4e4d9ea3476eb021b76f2c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.012223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33510eacdc5242f2a60fe36cfdfa2610, user_id=c391d5c71f4e4d9ea3476eb021b76f2c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:10.016396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:10.155912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 898/1828] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:09 2022] PUT /identity/v3/projects/33510eacdc5242f2a60fe36cfdfa2610/users/c391d5c71f4e4d9ea3476eb021b76f2c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:10.162081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:10.166692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294b468250774bd6a5438fda3577e3ec', 'request_id': 'req-3451af84-908e-4b88-994c-e65090a781e7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:10.329757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294b468250774bd6a5438fda3577e3ec', 'request_id': 'req-3451af84-908e-4b88-994c-e65090a781e7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:10.338468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294b468250774bd6a5438fda3577e3ec', 'request_id': 'req-3451af84-908e-4b88-994c-e65090a781e7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:10.380976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] The token cache is being invalidate because project 294b468250774bd6a5438fda3577e3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:10.386458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:10.388671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3451af84-908e-4b88-994c-e65090a781e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:10.390777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 931/1829] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:09 2022] DELETE /identity/v3/projects/294b468250774bd6a5438fda3577e3ec => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:10.397043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b678fe-fe01-4ed2-82a0-62ef405d36d2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:10.398263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf23555-b367-4f55-aa19-eddc3b45c05f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:10.400211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b678fe-fe01-4ed2-82a0-62ef405d36d2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:10.402700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b678fe-fe01-4ed2-82a0-62ef405d36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.465057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-63b678fe-fe01-4ed2-82a0-62ef405d36d2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:10.469332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-63b678fe-fe01-4ed2-82a0-62ef405d36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:10.521922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:10.522834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:10.523325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:10.523804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.525044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:10.527238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:10.540775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 899/1830] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:10.545531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:10.548499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:10.564947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e587a-dd8e-4d04-b12f-40db9e4612b6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:10.577641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:10.578464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:10.578750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:10.579168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] PATH_INFO: `/v3/projects/33510eacdc5242f2a60fe36cfdfa2610/users/c391d5c71f4e4d9ea3476eb021b76f2c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.583090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33510eacdc5242f2a60fe36cfdfa2610, user_id=c391d5c71f4e4d9ea3476eb021b76f2c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:10.586104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfc236-6b05-4321-8a4b-30038baeaca2 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:10.629157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 900/1831] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:10 2022] PUT /identity/v3/projects/33510eacdc5242f2a60fe36cfdfa2610/users/c391d5c71f4e4d9ea3476eb021b76f2c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:10.646746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:10.647193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:10.647702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.682187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 932/1832] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:10.705057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:10.705944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:10.707283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:10.725597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] MFA Rules not processed for user `c391d5c71f4e4d9ea3476eb021b76f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:10.727200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:10.736920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:10.781860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:10.787487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:10.894620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:10.901889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 901/1833] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:10.946943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:10.948408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:10.979883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 933/1834] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:10.980954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.003305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f610c-065e-4cb2-925c-64fc0a0ea26e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.020611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.021511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.022306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.022727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.023546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:11.024008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.025800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.052147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 934/1835] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:11.065619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.079753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103c84-4ed4-41c7-8ec7-dc2f482c589a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.091778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.092658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.093172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.093600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.094399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.096461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.208258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f62ff-5c18-4808-bced-d1c0b42c9f07 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.237362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.241497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.243131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.244374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.300628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.311105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.329955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 935/1836] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:11 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:11.333891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.353475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 902/1837] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:11.469966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbdb82-039f-4fe4-b358-6eaff2cb7c2d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.479168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.479872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.480163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.480468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.481169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.488310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.738404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 936/1838] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:11 2022] POST /identity/v3/users => generated 292 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:11.752206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.805727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2ae6-3122-475c-85d4-fd4bab9c7d91 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.831164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443810-345b-4355-b404-919e69757567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.832884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443810-345b-4355-b404-919e69757567 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.833073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443810-345b-4355-b404-919e69757567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.835569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8443810-345b-4355-b404-919e69757567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.836764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443810-345b-4355-b404-919e69757567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.843395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8443810-345b-4355-b404-919e69757567 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.870897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 903/1839] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:11.873452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.889180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4d53e-dd5d-4ce9-a613-4339879eab1c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.894497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.895140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.895613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.896137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:11.896892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:11.899118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:11.911084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 937/1840] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:11.915197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443810-345b-4355-b404-919e69757567 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:11.934028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8443810-345b-4355-b404-919e69757567 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:11.950609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:11.954824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:11.956240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:11.957213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] PATH_INFO: `/v3/projects/34ca9939a48246998a97431e4698418e/users/d382ee0f0a51447cabeac5cfa9857c3b/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:12.019414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ca9939a48246998a97431e4698418e, user_id=d382ee0f0a51447cabeac5cfa9857c3b, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:12.022730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5317ff-6aee-433d-945b-f2ac8eb2ea7c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:12.039237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:12.042669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:12.067516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151abcb-0cd6-4f1b-9004-ad199700cc0f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:12.077743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:12.077743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:12.079359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:12.079359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] PATH_INFO: `/v3/projects/1e2c2abf04ba4fa0a60b7bde03fc9c47` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:12.080269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2c2abf04ba4fa0a60b7bde03fc9c47)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:12.087480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:12.232479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 904/1841] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:11 2022] PUT /identity/v3/projects/34ca9939a48246998a97431e4698418e/users/d382ee0f0a51447cabeac5cfa9857c3b/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:12.247997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:12.248290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:12.248630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:12.288242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] MFA Rules not processed for user `d382ee0f0a51447cabeac5cfa9857c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:12.289717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:12.416676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 905/1842] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:12.421191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:12.481725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2c2abf04ba4fa0a60b7bde03fc9c47', 'request_id': 'req-e50e2307-8177-4587-90bf-d1ffaedac730'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:12.614819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054a03-72ba-4746-ab88-a5982d9e34e9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:12.618838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2c2abf04ba4fa0a60b7bde03fc9c47', 'request_id': 'req-e50e2307-8177-4587-90bf-d1ffaedac730'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:12.627637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2c2abf04ba4fa0a60b7bde03fc9c47', 'request_id': 'req-e50e2307-8177-4587-90bf-d1ffaedac730'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:12.680665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] The token cache is being invalidate because project 1e2c2abf04ba4fa0a60b7bde03fc9c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:12.680665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:12.680969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:12.686643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 938/1843] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:12 2022] DELETE /identity/v3/projects/1e2c2abf04ba4fa0a60b7bde03fc9c47 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:12.687960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:12.689893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:12.751316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:12.753803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:12.754948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:12.755378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:12.758690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:12.761158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:12.799358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e2307-8177-4587-90bf-d1ffaedac730 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:12.805992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:12.806650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:12.806956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:12.807233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] PATH_INFO: `/v3/users/a8de13c0eecb4be09c0963ada1ac093f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:12.809208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8de13c0eecb4be09c0963ada1ac093f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:12.819201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:12.903965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 906/1844] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:12.916924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:12.929167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:13.084656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6741-f5b1-448b-ab82-65e55ccddff8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:13.090151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:13.090930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.091319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.091704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.093405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:13.094799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:13.210128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8de13c0eecb4be09c0963ada1ac093f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:13.250941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 907/1845] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:12 2022] POST /identity/v3/users => generated 296 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:13.251993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:13.277096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d572-e652-46b5-990c-4d6a9cb3f90b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:13.294079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:13.296441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.297301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.297845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.299111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:13.302185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:13.318145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 908/1846] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:13.327571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:13.344056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8de13c0eecb4be09c0963ada1ac093f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:13.344593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfb31-65ff-4f80-beaa-d6fa5aeaf677 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:13.345492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8de13c0eecb4be09c0963ada1ac093f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:13.365525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:13.366213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.366699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.367522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] PATH_INFO: `/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e/users/7c04aa2fd6914178a899f363537e2ad0/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.378091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8de13c0eecb4be09c0963ada1ac093f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:13.390294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8de13c0eecb4be09c0963ada1ac093f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:13.401498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 939/1847] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:12 2022] DELETE /identity/v3/users/a8de13c0eecb4be09c0963ada1ac093f => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:13.425446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2941f5bcd64424bf67f869cdb2fd0e, user_id=7c04aa2fd6914178a899f363537e2ad0, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:13.428158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:13.580763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 909/1848] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:13 2022] PUT /identity/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e/users/7c04aa2fd6914178a899f363537e2ad0/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:13.583130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:13.585584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:13.710288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19380a86-98b6-4a29-a01c-631eea51acb1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:13.802332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:13.803002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.803314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.803653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.804444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:13.806445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a016d90-660d-453b-b76e-e70b61fa2309 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:13.825608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 940/1849] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:13.831662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:13.849263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d095f81-28dd-479b-8947-28010ffcf8b0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:13.855224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:13.855927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.856329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.856772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] PATH_INFO: `/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e/users/7c04aa2fd6914178a899f363537e2ad0/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.872226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2941f5bcd64424bf67f869cdb2fd0e, user_id=7c04aa2fd6914178a899f363537e2ad0, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:13.872226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:13.883929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 910/1850] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:13 2022] PUT /identity/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e/users/7c04aa2fd6914178a899f363537e2ad0/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:13.898193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:13.898558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:13.899614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:13.968670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] MFA Rules not processed for user `7c04aa2fd6914178a899f363537e2ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:13.970401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.023855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:14.025892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.135850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 941/1851] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:14.153368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:14.156607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.200905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e4a-e71d-41db-9d8e-0b0b741f47ea admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:14.213710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:14.215841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:14.216867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:14.217370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] PATH_INFO: `/v3/users/470ccd0a014d4099a3365713bb5e3791` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:14.220672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=470ccd0a014d4099a3365713bb5e3791)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:14.223188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:14.255802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ac7e0-5bdf-46c5-9237-f48a93bf0ce4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:14.266037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:14.266923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:14.267221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:14.267503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:14.304726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:14.306198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:14.320493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 942/1852] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:14.480884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:14.493002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ce6a-dd5d-4cab-bc0c-6173eaf2d064 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:14.496907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:14.497510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:14.497783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:14.498099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:14.501127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.547629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470ccd0a014d4099a3365713bb5e3791'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.628132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:14.629823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:14.641118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 943/1853] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:14.642212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:14.643627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.658820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f439d-c661-4b12-b898-136d7dd56aa0 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:14.663819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:14.664589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:14.664946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:14.665305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] PATH_INFO: `/v3/projects/79826e76995345f2adc9c6280b7f4f4b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:14.666570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79826e76995345f2adc9c6280b7f4f4b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:14.668669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:14.703237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470ccd0a014d4099a3365713bb5e3791'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.703774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470ccd0a014d4099a3365713bb5e3791'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.716984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470ccd0a014d4099a3365713bb5e3791'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.749521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470ccd0a014d4099a3365713bb5e3791'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.769710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 911/1854] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:14 2022] DELETE /identity/v3/users/470ccd0a014d4099a3365713bb5e3791 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:14.770966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:14.774636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:14.890417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a528e66-25c3-4ed3-818e-1c6c183d5a2c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:14.932756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79826e76995345f2adc9c6280b7f4f4b', 'request_id': 'req-ce893edd-f20c-4935-a3ba-532a951a3d5d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:14.972970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:14.973642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:14.973927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:14.974219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] PATH_INFO: `/v3/users/c36ca39f51d84f85b929835aeae73dd9` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:14.975388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36ca39f51d84f85b929835aeae73dd9)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:14.977387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:15.065929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79826e76995345f2adc9c6280b7f4f4b', 'request_id': 'req-ce893edd-f20c-4935-a3ba-532a951a3d5d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.075279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79826e76995345f2adc9c6280b7f4f4b', 'request_id': 'req-ce893edd-f20c-4935-a3ba-532a951a3d5d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.089347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] The token cache is being invalidate because project 79826e76995345f2adc9c6280b7f4f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:15.089710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.090461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ce893edd-f20c-4935-a3ba-532a951a3d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.092075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 944/1855] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:14 2022] DELETE /identity/v3/projects/79826e76995345f2adc9c6280b7f4f4b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:15.094350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9114a-4e73-4524-9f51-12f61340c584 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.094635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9114a-4e73-4524-9f51-12f61340c584 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.095010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9114a-4e73-4524-9f51-12f61340c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.116175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7df9114a-4e73-4524-9f51-12f61340c584 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:15.117763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7df9114a-4e73-4524-9f51-12f61340c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.131152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 945/1856] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:15.132943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.133067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.133339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.160471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:15.161879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.180730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 946/1857] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:15.180730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:15.181682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.252986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36ca39f51d84f85b929835aeae73dd9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.264225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad5838-5af9-4cd6-9d99-c1b5421d15f3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:15.269144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:15.269778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.270061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.270340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.280964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:15.282952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7fb63-2909-4b4d-b187-fd292401352a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:15.295645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 947/1858] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:15.297273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.300091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.300091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.351624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:15.353742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.364487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 948/1859] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:15.370987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36ca39f51d84f85b929835aeae73dd9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.371947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36ca39f51d84f85b929835aeae73dd9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.387067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:15.396049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36ca39f51d84f85b929835aeae73dd9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.403720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafb35-ca35-4c69-aefe-f295611436a0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:15.422337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:15.422939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.423217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.424090 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.424957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97cf1f71-0f11-4494-9878-ecb8235fbb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36ca39f51d84f85b929835aeae73dd9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:15.427365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:15.427365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:15.429095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:15.438230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 912/1860] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:14 2022] DELETE /identity/v3/users/c36ca39f51d84f85b929835aeae73dd9 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:15.443400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.444365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.448235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.465280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 949/1861] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:15.476410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:15.478792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:15.480565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.485320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.495125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f3a-d34c-4f37-bf90-5b283491c6ec admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:15.606520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:15.607286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.607580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.607891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.610028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:15.612217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:15.621897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 913/1862] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:15.632561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:15.636461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:15.747003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:15.771963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb11b1-251b-490c-836a-28dd1fb57764 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:15.787117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:15.787645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:15.787867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:15.788206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:15.804690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 950/1863] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/projects => generated 379 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:15.805770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:15.806628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:15.807922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:15.821002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 914/1864] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:15.983320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59316dce-4532-40ae-b0d6-e6040023d79d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:15.998249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:15.999902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.000398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.001075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.002020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.004299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:16.025906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:16.172922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 951/1865] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:15 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:16.173030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:16.222250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74506fe5-97e5-4c67-bcac-f81cf05e2025 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:16.238128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:16.238603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.238846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.239139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.239801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.241973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:16.287763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 915/1866] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:16.293308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:16.321504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3299c-a368-4dc6-99d7-e7ab6874cc86 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:16.336772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:16.341931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.342312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.342699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.343600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.346899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:16.373504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 952/1867] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:16.379487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:16.400575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05774-352f-4507-be5f-066634cf98a5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:16.429571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:16.430818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.431211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.431493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] PATH_INFO: `/v3/projects/03e3e485cc4c478ba4babefd06b99cc8/users/0e7d6c7e29cf4953a3ce06fc72bc892d/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.456301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:16.458001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:16.462423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e3e485cc4c478ba4babefd06b99cc8, user_id=0e7d6c7e29cf4953a3ce06fc72bc892d, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.471264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:16.493464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53de2f-3f24-4f0f-aa81-22e652c39f14 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:16.494659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:16.507470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.507470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.507895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] PATH_INFO: `/v3/projects/88e8507cea2a46af8cd58221a1d5463d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.509167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e8507cea2a46af8cd58221a1d5463d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.526344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:16.656564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 916/1868] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:16 2022] PUT /identity/v3/projects/03e3e485cc4c478ba4babefd06b99cc8/users/0e7d6c7e29cf4953a3ce06fc72bc892d/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:16.660573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:16.660573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:16.820798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e51ca-0d2b-483f-a633-5bd8571213b5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:16.830205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:16.831030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:16.831451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:16.831887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] PATH_INFO: `/v3/projects/a5f48cd666ba43dbafd7efff96341c9a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:16.833448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f48cd666ba43dbafd7efff96341c9a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:16.835830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:17.372609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e8507cea2a46af8cd58221a1d5463d', 'request_id': 'req-aeeaf433-d58f-4039-bab7-632138a3325d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.578493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f48cd666ba43dbafd7efff96341c9a', 'request_id': 'req-5ac9d8f5-180e-4667-853a-bad96c581d15'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.659088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e8507cea2a46af8cd58221a1d5463d', 'request_id': 'req-aeeaf433-d58f-4039-bab7-632138a3325d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.667984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e8507cea2a46af8cd58221a1d5463d', 'request_id': 'req-aeeaf433-d58f-4039-bab7-632138a3325d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.680954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] The token cache is being invalidate because project 88e8507cea2a46af8cd58221a1d5463d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:17.681352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.681921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aeeaf433-d58f-4039-bab7-632138a3325d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.683481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 953/1869] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:16 2022] DELETE /identity/v3/projects/88e8507cea2a46af8cd58221a1d5463d => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:17.685103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:17.685389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:17.685668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:17.716777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] MFA Rules not processed for user `0e7d6c7e29cf4953a3ce06fc72bc892d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:17.718665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:17.786481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 954/1870] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:17.787494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:17.788820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:17.791963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f48cd666ba43dbafd7efff96341c9a', 'request_id': 'req-5ac9d8f5-180e-4667-853a-bad96c581d15'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.798788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f48cd666ba43dbafd7efff96341c9a', 'request_id': 'req-5ac9d8f5-180e-4667-853a-bad96c581d15'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.812758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] The token cache is being invalidate because project a5f48cd666ba43dbafd7efff96341c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:17.813117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.813834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:17.815528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 917/1871] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:16 2022] DELETE /identity/v3/projects/a5f48cd666ba43dbafd7efff96341c9a => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:17.816560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:17.818440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:17.861115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023abfd-206d-4a4b-a21c-4a8f2a4b1e26 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:17.866088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:17.866901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:17.867254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:17.867602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] PATH_INFO: `/v3/users/c391d5c71f4e4d9ea3476eb021b76f2c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:17.868871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c391d5c71f4e4d9ea3476eb021b76f2c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:17.870893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:17.888901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d8f5-180e-4667-853a-bad96c581d15 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:17.894063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:17.894689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:17.894973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:17.895662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:17.895900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:17.897916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.081235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 918/1872] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:17 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:18.082460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.085072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:18.141224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c391d5c71f4e4d9ea3476eb021b76f2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.166581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342270a-9237-4bea-980e-185b1cd05fd9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:18.178868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:18.178868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:18.178868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:18.178868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] PATH_INFO: `/v3/users/bda1add4889f4d25b92ac7c79a2422a5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:18.179332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda1add4889f4d25b92ac7c79a2422a5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:18.179580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.224532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c391d5c71f4e4d9ea3476eb021b76f2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.225563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c391d5c71f4e4d9ea3476eb021b76f2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.239507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c391d5c71f4e4d9ea3476eb021b76f2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.247906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c391d5c71f4e4d9ea3476eb021b76f2c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.253352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 955/1873] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:17 2022] DELETE /identity/v3/users/c391d5c71f4e4d9ea3476eb021b76f2c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:18.254143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.255662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:18.332890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e437-89a0-404a-847a-b7ac3e89b4e2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:18.337520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:18.338197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:18.338478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:18.338752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:18.339399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:18.341377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.508613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda1add4889f4d25b92ac7c79a2422a5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.537491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 956/1874] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:18 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:18.541373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.553548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc29f6-f3b5-4c52-83fc-c9d770ebd5e6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:18.573324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:18.573638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:18.574530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:18.574829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:18.575763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:18.578199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.605417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 957/1875] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:18.610096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.634578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda1add4889f4d25b92ac7c79a2422a5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.635562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda1add4889f4d25b92ac7c79a2422a5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.644644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda1add4889f4d25b92ac7c79a2422a5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.648187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf434-4b4d-41f4-a148-0f19c5e2ce1f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:18.655173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:18.657511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:18.657862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:18.658964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] PATH_INFO: `/v3/projects/c0c6ec12b7d24e029df37f684d337663/users/46e6287f2e954caf85869f107a4cb7b9/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:18.668989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda1add4889f4d25b92ac7c79a2422a5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:18.679873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 919/1876] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:18 2022] DELETE /identity/v3/users/bda1add4889f4d25b92ac7c79a2422a5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:18.684126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c6ec12b7d24e029df37f684d337663, user_id=46e6287f2e954caf85869f107a4cb7b9, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:18.687752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.818918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 958/1877] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:18 2022] PUT /identity/v3/projects/c0c6ec12b7d24e029df37f684d337663/users/46e6287f2e954caf85869f107a4cb7b9/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:18.823130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.825153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:18.902273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9eaa9-d445-4325-be81-57a785b03a2d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:18.965112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:18.965733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:18.966015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:18.966291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:18.967389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:18.970416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:18.984076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 920/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:18.987742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.994275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:18.998713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:18.998883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099342c-d74f-4c9c-ab19-1b9bab0de97f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.003845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.004662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.004867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.005291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] PATH_INFO: `/v3/projects/c0c6ec12b7d24e029df37f684d337663/users/46e6287f2e954caf85869f107a4cb7b9/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.007207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c6ec12b7d24e029df37f684d337663, user_id=46e6287f2e954caf85869f107a4cb7b9, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.009932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f299c9-dc55-45a8-984c-9674be336991 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.015629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b7857-7b5a-4e89-b222-353d629cf5d5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.021811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 959/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:18 2022] PUT /identity/v3/projects/c0c6ec12b7d24e029df37f684d337663/users/46e6287f2e954caf85869f107a4cb7b9/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:19.033931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.034291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.034646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.074347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] MFA Rules not processed for user `46e6287f2e954caf85869f107a4cb7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:19.079151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.109334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.110003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.110292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.110572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] PATH_INFO: `/v3/projects/33510eacdc5242f2a60fe36cfdfa2610` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.111784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33510eacdc5242f2a60fe36cfdfa2610)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.113939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.163078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 960/1880] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:19.176329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.177755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.241298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862e81b-4fb2-4ba5-b10e-c05e820e8578 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.245355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.246006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.246289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.246563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.251536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.324287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33510eacdc5242f2a60fe36cfdfa2610', 'request_id': 'req-bb89e187-8e49-4df9-a087-ea92bb9c9342'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.329764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.332666 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.343868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 961/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:19.345828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.347314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.365059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea61f0-d882-459c-ba5c-9c1e020b7735 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.437375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.438489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.439545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.439828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] PATH_INFO: `/v3/projects/44b0c459ca1045e38aa293961b62af13` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.441181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b0c459ca1045e38aa293961b62af13)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.443552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.457424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33510eacdc5242f2a60fe36cfdfa2610', 'request_id': 'req-bb89e187-8e49-4df9-a087-ea92bb9c9342'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.463663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33510eacdc5242f2a60fe36cfdfa2610', 'request_id': 'req-bb89e187-8e49-4df9-a087-ea92bb9c9342'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.476321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] The token cache is being invalidate because project 33510eacdc5242f2a60fe36cfdfa2610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:19.476643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.477332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-bb89e187-8e49-4df9-a087-ea92bb9c9342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.478962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 921/1882] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:18 2022] DELETE /identity/v3/projects/33510eacdc5242f2a60fe36cfdfa2610 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:19.484479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7d78-a5af-44c6-94b4-8a746f0ea3ac None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.484877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7d78-a5af-44c6-94b4-8a746f0ea3ac None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.485157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7d78-a5af-44c6-94b4-8a746f0ea3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.505683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-501f7d78-a5af-44c6-94b4-8a746f0ea3ac None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:19.506889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-501f7d78-a5af-44c6-94b4-8a746f0ea3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.515726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 922/1883] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:19.523445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.523813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.524111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.544121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:19.545423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.553962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 923/1884] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:19.558254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.568980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd925-54e6-4092-bb8a-7fa11755f73d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.581426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b0c459ca1045e38aa293961b62af13', 'request_id': 'req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.630276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.630926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.631210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.631487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.632138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:19.632483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.634269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.648946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 924/1885] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:10:19.653599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.666232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc360a8-e52e-4940-b843-7995a44943d3 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.671995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.673421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.673789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.674135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.674853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.676804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e402b1-2dd2-4e8b-b49d-687e242a32d0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.708238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b0c459ca1045e38aa293961b62af13', 'request_id': 'req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.714598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b0c459ca1045e38aa293961b62af13', 'request_id': 'req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.727158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] The token cache is being invalidate because project 44b0c459ca1045e38aa293961b62af13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:19.727456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.728189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:19.729738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 962/1886] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:19 2022] DELETE /identity/v3/projects/44b0c459ca1045e38aa293961b62af13 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:19.733429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.735044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.748052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a0c0-4e9f-46d5-a5de-f9b5e0e852bc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.754106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.758751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.758751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.758751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] PATH_INFO: `/v3/users/d382ee0f0a51447cabeac5cfa9857c3b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.758751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d382ee0f0a51447cabeac5cfa9857c3b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.758751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.848733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 925/1887] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:19.850253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.850792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.851163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.873033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:19.875179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.948552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 926/1888] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:19.948552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.948552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.961912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3ea2-5986-4302-9fb6-2b0c9f4d4615 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.967006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.967696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.967988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.968261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.969596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.971093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40e6b-8418-4b54-85bc-13b422bbbf67 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.103396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd382ee0f0a51447cabeac5cfa9857c3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:20.140352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 927/1889] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:19 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:20.140352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.140352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.140352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.160008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:20.161259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.169336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 928/1890] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:20.170126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.180570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fc08-c37c-4d5a-93ef-eba827b51d8c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.185315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.185902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.186189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.187391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.188379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.190012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.200250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 929/1891] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:20.216678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.216678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96696cb0-074f-43f8-ab8f-18482ee157e6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.217084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.217711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.217993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.218443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.219098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:20.219410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.221065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.235255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 930/1892] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:20.239805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.239920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd382ee0f0a51447cabeac5cfa9857c3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:20.239920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd382ee0f0a51447cabeac5cfa9857c3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:20.245640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca450cc-9060-4680-b926-e66ae43866d8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.251245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.251851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.252133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.252408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.253105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.253872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd382ee0f0a51447cabeac5cfa9857c3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:20.254699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.261108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd382ee0f0a51447cabeac5cfa9857c3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:20.264830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 931/1893] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:20.268613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.268613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.268816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 963/1894] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:19 2022] DELETE /identity/v3/users/d382ee0f0a51447cabeac5cfa9857c3b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:20.271470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.272850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.281326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3739fc-f8f7-4bb8-9c2c-d9bef3818881 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.360256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.360917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.361205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.361481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.362132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.364072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11247e6a-c42d-4161-b7e9-c1c2e7e23b0c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.373434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517d65-ef88-4486-83cb-62030a540a00 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.380470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.381187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.381694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.382159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] PATH_INFO: `/v3/projects/68092d3a0c31414db9be1fae39d2cbec/users/2f64414eee0b481685aee1ab4cf4b6d2/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.397768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] RBAC: Authorizing `identity:create_grant(project_id=68092d3a0c31414db9be1fae39d2cbec, user_id=2f64414eee0b481685aee1ab4cf4b6d2, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.400584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.521964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 932/1895] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:20 2022] POST /identity/v3/projects => generated 409 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:20.521964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d8ed-491c-4f89-b1c3-bf6e4408514b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.521964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d8ed-491c-4f89-b1c3-bf6e4408514b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.521964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d8ed-491c-4f89-b1c3-bf6e4408514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.541607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5b29d8ed-491c-4f89-b1c3-bf6e4408514b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:20.543059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5b29d8ed-491c-4f89-b1c3-bf6e4408514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.558158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 964/1896] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:20 2022] PUT /identity/v3/projects/68092d3a0c31414db9be1fae39d2cbec/users/2f64414eee0b481685aee1ab4cf4b6d2/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:20.567251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.621106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 933/1897] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:20.623147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.623399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.624776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.630054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:20.646909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e06-3d71-4716-9420-822a1fb643da admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.651699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.652316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.652658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.652940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.653610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.655694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.660009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:20.661384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.671777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 934/1898] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:20.676464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.676464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:20.732889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1deed2-12b1-44cf-8bd6-68af5769b3b0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.736757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.737375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.737658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.737931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.747695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.750034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.759619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 935/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:20.760614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.769606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687289-12c6-4d70-bada-624c07253ce6 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.773463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.774056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.774341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.774615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.784768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.786202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.797914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 936/1900] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:20.832945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 965/1901] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:20 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:20.838086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.849524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9bc13-c7d3-46b9-8fd7-9edfc4f34d21 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.859156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.860093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.860562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.860983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.861801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.863750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.878614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 937/1902] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:20.882783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.893896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50074-76a4-470e-b718-f0b1b7bae5a3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.898854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.899530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.900041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.900358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:20.901129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:20.902910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0f2d-c2bc-4a08-9486-5d445efdc5da admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:20.915079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 966/1903] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:20.933443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:20.950534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63908d-0598-4713-80b1-4411013a382d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:20.975428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:20.976411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:20.976930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:20.978119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] PATH_INFO: `/v3/projects/02e9d040c0564d138328d7399c110fe6/users/073cf0fb4b9346b1b25ac756da33ff59/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.015876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e9d040c0564d138328d7399c110fe6, user_id=073cf0fb4b9346b1b25ac756da33ff59, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.018703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:21.170518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 938/1904] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:20 2022] PUT /identity/v3/projects/02e9d040c0564d138328d7399c110fe6/users/073cf0fb4b9346b1b25ac756da33ff59/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:21.189632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.189814 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.190048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.220615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] MFA Rules not processed for user `073cf0fb4b9346b1b25ac756da33ff59`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:21.222242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:21.294091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 967/1905] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:21.299416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:21.362841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4c1db-6745-477b-bffe-da93547a501c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:21.370227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:21.371819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:21.375633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:21.376288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.376604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.376882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.377532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.379569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:21.390368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e12c-ccbe-4853-b32a-297738b52caf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:21.396322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:21.397322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.397849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.398227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] PATH_INFO: `/v3/projects/34ca9939a48246998a97431e4698418e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.399512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ca9939a48246998a97431e4698418e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.401770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:21.502279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 939/1906] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:21 2022] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:21.502279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:21.502279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:21.553911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ca9939a48246998a97431e4698418e', 'request_id': 'req-296bb02f-8bd1-4935-aff8-58f35b07a599'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:21.566736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2b92f-d888-49e7-943c-f6c73db8da60 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:21.622456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:21.622456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.622456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.622456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.622934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:21.682620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ca9939a48246998a97431e4698418e', 'request_id': 'req-296bb02f-8bd1-4935-aff8-58f35b07a599'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:21.693633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ca9939a48246998a97431e4698418e', 'request_id': 'req-296bb02f-8bd1-4935-aff8-58f35b07a599'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:21.712604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] The token cache is being invalidate because project 34ca9939a48246998a97431e4698418e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:21.713173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:21.714045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:21.716200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 968/1907] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:21 2022] DELETE /identity/v3/projects/34ca9939a48246998a97431e4698418e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:21.717254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:21.720576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:21.722530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.726645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:21.741872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 940/1908] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:21.742756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:21.831931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7005-7c25-4801-ac23-c42390390142 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:21.848259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:21.848259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.848259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.848259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] PATH_INFO: `/v3/users/7c04aa2fd6914178a899f363537e2ad0` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.848930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c04aa2fd6914178a899f363537e2ad0)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.864925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:21.908654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb02f-8bd1-4935-aff8-58f35b07a599 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:21.914707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:21.915672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:21.916118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:21.916582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:21.917444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:21.919851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.012917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:22.022823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 969/1909] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:21 2022] POST /identity/v3/users => generated 311 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:22.034073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:22.059870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08c5a6-0218-4913-8386-e915698d1e4c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:22.069256 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:22.073459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.073459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.073459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.073459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:22.074353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.097777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 970/1910] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:22.099241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:22.122212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c3e65-cd7f-4a5d-934d-add09eb09535 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:22.134804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:22.135570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.135904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.136243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] PATH_INFO: `/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d/users/238d50f859c245f686d9ae7c9e995d4b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.152729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c59b61a21a4aff9264c1b6deec1e3d, user_id=238d50f859c245f686d9ae7c9e995d4b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:22.157785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.227792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c04aa2fd6914178a899f363537e2ad0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:22.247184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:22.306621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 971/1911] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:22 2022] PUT /identity/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d/users/238d50f859c245f686d9ae7c9e995d4b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:22.317290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:22.463460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7fd9-e488-4d5d-9c41-e75db24c76e3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:22.463460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:22.463460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.463460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.463959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.463959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:22.463959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.463959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 972/1912] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:22.472047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:22.482848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5d468-29a2-41ee-b972-39ee27daa5d5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:22.489475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:22.490157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.490438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.490719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] PATH_INFO: `/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d/users/238d50f859c245f686d9ae7c9e995d4b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.492740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c59b61a21a4aff9264c1b6deec1e3d, user_id=238d50f859c245f686d9ae7c9e995d4b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:22.495591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea11ba-13ce-458f-a204-3211c3ea4610 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.508043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 973/1913] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:22 2022] PUT /identity/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d/users/238d50f859c245f686d9ae7c9e995d4b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:22.519707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.520072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.520417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.552781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] MFA Rules not processed for user `238d50f859c245f686d9ae7c9e995d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:22.554030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:22.633872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 974/1914] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:22.645046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:22.646494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:22.711966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97229e60-be30-405a-b3d3-c2eec77ac893 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:22.716340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:22.716993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:22.717310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:22.718117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:22.730563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:22.732995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:22.746568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 975/1915] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:22.849226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c04aa2fd6914178a899f363537e2ad0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:22.869277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c04aa2fd6914178a899f363537e2ad0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:22.869277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c04aa2fd6914178a899f363537e2ad0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:22.884242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c04aa2fd6914178a899f363537e2ad0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:22.896401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 941/1916] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:21 2022] DELETE /identity/v3/users/7c04aa2fd6914178a899f363537e2ad0 => generated 0 bytes in 1154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:24.008088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.009707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.121009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf103b8b-c7b8-4874-b6f4-ccb42b550245 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:24.123453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.125739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.212281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:24.213258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.213645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.214027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] PATH_INFO: `/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.215732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aab25a-b19c-40a6-983a-e52c00ec95a6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:24.216197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2941f5bcd64424bf67f869cdb2fd0e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:24.219033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:24.221790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:24.222720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.223011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.223291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.225804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.320678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:24.320678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f98d62-2673-492d-8994-417baf7f076f service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:24.329733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 942/1917] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:24.331080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.331377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.331666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.382940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] MFA Rules not processed for user `2f64414eee0b481685aee1ab4cf4b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:24.385457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.396743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2941f5bcd64424bf67f869cdb2fd0e', 'request_id': 'req-cb18aa2e-75e0-42d1-9ff5-9531d687417e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:24.517391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2941f5bcd64424bf67f869cdb2fd0e', 'request_id': 'req-cb18aa2e-75e0-42d1-9ff5-9531d687417e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:24.527134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2941f5bcd64424bf67f869cdb2fd0e', 'request_id': 'req-cb18aa2e-75e0-42d1-9ff5-9531d687417e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:24.553056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] The token cache is being invalidate because project ef2941f5bcd64424bf67f869cdb2fd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:24.553696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:24.555442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb18aa2e-75e0-42d1-9ff5-9531d687417e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:24.558519 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 976/1918] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:24 2022] DELETE /identity/v3/projects/ef2941f5bcd64424bf67f869cdb2fd0e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:24.563422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 943/1919] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:24.567136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734390-b253-44bf-8c42-17c31b86f20e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.567136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734390-b253-44bf-8c42-17c31b86f20e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.567653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69734390-b253-44bf-8c42-17c31b86f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.577505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.582863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.597967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-69734390-b253-44bf-8c42-17c31b86f20e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:24.599284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-69734390-b253-44bf-8c42-17c31b86f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.732851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 977/1920] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:24.735646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc37e-2936-47fb-9fa7-c8a6daa1a943 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:24.737705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.739611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.739611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.767569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:24.768210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.768486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.768946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.769766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:24.771705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:24.798382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:24.800692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:24.816599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 978/1921] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:24.825339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.839284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4e5f5-a1a9-407d-83d5-69da3ecd6637 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:24.844313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:24.845131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.845577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.845953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.846848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:24.847247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:24.848984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:24.865532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 979/1922] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:24.870699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.886866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57219-4299-4ecc-9d0b-e950e1b32f4c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:24.892944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:24.893177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:24.893425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:24.893762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:24.894426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:24.896559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:24.946898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 944/1923] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/projects => generated 371 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:24.951505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:24.953301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:25.021894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929349e6-dc98-4b8e-a95b-9612ffe40278 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.027447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.028065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.028396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.028647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.029278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.031770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.164121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 945/1924] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:25.167522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.169227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 980/1925] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:24 2022] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:25.170167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.180669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46744-e220-4df3-a812-3422078c45ac admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.239475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46de5f-0d15-420c-8119-10481bf118d4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.244173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.244725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.244851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.245080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.245352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.245477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.245639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.245919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.246019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.246647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.247940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.248199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.259144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 946/1926] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:25.263221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.273421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2a73e-8055-46d1-b1fc-e0681340fe8c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.277910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.278557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.278846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.279129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] PATH_INFO: `/v3/projects/476c75d798904506bf29e52b4a4eae10/users/f2a64e1e2ffc4ec6ab00a1da88b132e5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.294607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476c75d798904506bf29e52b4a4eae10, user_id=f2a64e1e2ffc4ec6ab00a1da88b132e5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.298039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.399120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 981/1927] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:25 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:25.403138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.413821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e607e-0799-4c1f-9abb-4e90de5ea460 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.418538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.419132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.419492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.419768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.420398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.422220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.445858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 982/1928] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:25.446226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 947/1929] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:25 2022] PUT /identity/v3/projects/476c75d798904506bf29e52b4a4eae10/users/f2a64e1e2ffc4ec6ab00a1da88b132e5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:25.449610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.451129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.480194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ecf37-0036-4054-899f-74187c1ee299 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.572110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.573175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.573445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.573726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.574383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.576016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.587504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b610c46-ac4b-45e7-b770-48109bd31885 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.589799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 983/1930] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:25.594915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.596135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.597395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.597690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.597987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.598651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.600258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.615726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e7af8-64db-4fd2-a87e-5a2fbd736d78 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.619700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.620325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.620641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.620924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] PATH_INFO: `/v3/projects/7f9e49ebc1e145d4aa09ff057606e9f1/users/edb3099b8c704a96bc5ed16cc580c880/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.627561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 948/1931] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:25.628606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:25.642828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2259-afbf-4bd3-a7bd-a8eff673a760 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:25.649361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:25.650237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.650510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.650792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] PATH_INFO: `/v3/projects/476c75d798904506bf29e52b4a4eae10/users/f2a64e1e2ffc4ec6ab00a1da88b132e5/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.652816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e49ebc1e145d4aa09ff057606e9f1, user_id=edb3099b8c704a96bc5ed16cc580c880, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.653553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=476c75d798904506bf29e52b4a4eae10, user_id=f2a64e1e2ffc4ec6ab00a1da88b132e5, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:25.657180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.657359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177203a1-6fbc-4f2f-8257-e906d215b18b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:25.672716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 949/1932] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:25 2022] PUT /identity/v3/projects/476c75d798904506bf29e52b4a4eae10/users/f2a64e1e2ffc4ec6ab00a1da88b132e5/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:25.789804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 984/1933] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:25 2022] PUT /identity/v3/projects/7f9e49ebc1e145d4aa09ff057606e9f1/users/edb3099b8c704a96bc5ed16cc580c880/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:25.802275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:25.802591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:25.802831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:25.834544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] MFA Rules not processed for user `edb3099b8c704a96bc5ed16cc580c880`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:25.836048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:25.915892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 950/1934] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:25.920402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:26.079816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad185d3-1fd9-48de-97a8-3cc5c516ad52 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:26.087824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:26.088638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.089018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.089303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.090488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:26.093294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:26.277549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:26.298605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 985/1935] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:25 2022] POST /identity/v3/projects => generated 379 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:26.304009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:26.318546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ebdd2-d333-40e8-8abf-0b920d037e21 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:26.374335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:26.388652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:26.389870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.390582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.391159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.392105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:26.394644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:26.546119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 951/1936] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:26 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:26.548963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:26.559311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd306c-96a7-4c35-9ac0-8de5befa8d75 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:26.565012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:26.565634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.565941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.566217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.566868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:26.568719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:26.584845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 986/1937] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:26.586460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:26.598063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29a71-b752-4cdd-926a-164eaf7e577b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:26.603589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:26.604595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.604984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.605363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.606522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:26.610047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4581efc-160a-4278-81cf-2c6b892f0240 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:26.627068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 952/1938] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:26.634273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:26.651282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf88fb-ecc0-4dd1-91dc-e6d338354c35 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:26.665187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:26.665879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.666164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.666465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] PATH_INFO: `/v3/projects/0e0a0bbec14f4bb18ab9240da5d1052b/users/774612e246ef47ad8dd3f4f1b05c7ac3/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.683218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0a0bbec14f4bb18ab9240da5d1052b, user_id=774612e246ef47ad8dd3f4f1b05c7ac3, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:26.687172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:26.813229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 987/1939] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:26 2022] PUT /identity/v3/projects/0e0a0bbec14f4bb18ab9240da5d1052b/users/774612e246ef47ad8dd3f4f1b05c7ac3/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:26.825157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:26.825553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:26.825925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:26.860163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] MFA Rules not processed for user `774612e246ef47ad8dd3f4f1b05c7ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:26.861435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:26.936903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 953/1940] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:26.942383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.018699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135a47-4cb4-4140-8d18-79c38ec10c3b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.023542 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.024161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.024458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.024751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.025421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.027342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.177719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 988/1941] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:26 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:27.183361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.200501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32644e7-c469-4646-a175-786fb88e6aad None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.274995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.275614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.275911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.276193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.276884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.278833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.430379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 954/1942] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:27 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:27.431692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.443449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88bb4-a4fc-4387-96bb-d8e2851bdfe9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.449012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.449649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.450034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.450274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.450951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.453223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.465113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 989/1943] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:27.470949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.481422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2138e1-6f6c-4773-913f-e15e3a71d459 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.487230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.488013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.488370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.488787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] PATH_INFO: `/v3/projects/602077aa018840cfb4bb38ae4faf82c4/users/30af92bc02c249acafd8b9eed9b14e33/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.505356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602077aa018840cfb4bb38ae4faf82c4, user_id=30af92bc02c249acafd8b9eed9b14e33, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.508217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ccb0-dd7d-4d9e-941c-75fca461d2a6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.616725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 955/1944] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:27 2022] PUT /identity/v3/projects/602077aa018840cfb4bb38ae4faf82c4/users/30af92bc02c249acafd8b9eed9b14e33/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:27.620695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.634834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61564-001a-42fb-9aff-a83fd34474ad admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.718132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.719009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.719456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.722158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.722158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.722444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.731841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab539-2b56-4e77-97de-575b96867118 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.732200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab539-2b56-4e77-97de-575b96867118 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.732472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ab539-2b56-4e77-97de-575b96867118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.744596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 990/1945] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:27.746627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:27.772992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7c94-f82b-4f14-b238-1b7bb53303ed admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:27.778985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f46ab539-2b56-4e77-97de-575b96867118 None None] MFA Rules not processed for user `f2a64e1e2ffc4ec6ab00a1da88b132e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:27.782107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:27.782583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f46ab539-2b56-4e77-97de-575b96867118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:27.783199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.783650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.784074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] PATH_INFO: `/v3/projects/602077aa018840cfb4bb38ae4faf82c4/users/30af92bc02c249acafd8b9eed9b14e33/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.786497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602077aa018840cfb4bb38ae4faf82c4, user_id=30af92bc02c249acafd8b9eed9b14e33, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:27.789626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdc6ce-ee27-4884-be60-d5a0a42ca939 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:27.808260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 991/1946] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:27 2022] PUT /identity/v3/projects/602077aa018840cfb4bb38ae4faf82c4/users/30af92bc02c249acafd8b9eed9b14e33/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:27.821969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.822701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.823773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.891370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] MFA Rules not processed for user `30af92bc02c249acafd8b9eed9b14e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:27.891370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:27.940112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 956/1947] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:27.950460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:27.950774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:27.951046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:27.974053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] MFA Rules not processed for user `2f64414eee0b481685aee1ab4cf4b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:27.975115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:27.980768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 992/1948] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:28.048816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 957/1949] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:28.057044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:28.058484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:28.141365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ccec8-68e9-4b51-a9bb-519e7912c148 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:28.147701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:28.152445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:28.152445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:28.152445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:28.152445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:28.162037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:28.163653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:28.173903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 993/1950] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:28.259413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:28.260946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:28.328438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662242-95c9-4794-9a83-e6d6dc7ff1f5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:28.332294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:28.332978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:28.333264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:28.333540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:28.343329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:28.345450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8b510-4f18-44aa-aa6d-dae526d5cea9 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:28.366771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 958/1951] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:28.626454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:28.637449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded27bf-2a46-4818-b0d6-7d88e35a45c2 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:28.641182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:28.641953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:28.642327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:28.642606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:28.705759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:28.707291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fda95-0f8c-46f7-8949-36f778b87e23 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:28.720559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 994/1952] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:28.749604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:28.969667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:28.970283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:28.970866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:28.973607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 959/1953] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:10:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:10:28.985891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:28.986338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:28.986796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:29.010147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:29.011686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:29.021510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 995/1954] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:29.036981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:29.039969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:29.064736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbf679-d476-43a6-a591-27d051c82b45 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:29.071320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:29.071940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:29.072226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:29.072502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:29.084156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:29.087163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f068ea-fd98-4d2f-b7a9-0885dd39392f service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:29.116804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 960/1955] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:29.689508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:29.690955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:29.766390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d010b19-2754-4694-a10b-a80cd7a5bade None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:29.772206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:29.773166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:29.773556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:29.773979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] PATH_INFO: `/v3/users/0e7d6c7e29cf4953a3ce06fc72bc892d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:29.775445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7d6c7e29cf4953a3ce06fc72bc892d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:29.778772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:30.135499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:30.154439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7d6c7e29cf4953a3ce06fc72bc892d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:30.268535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7d6c7e29cf4953a3ce06fc72bc892d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:30.269181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7d6c7e29cf4953a3ce06fc72bc892d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:30.294411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7d6c7e29cf4953a3ce06fc72bc892d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:30.302018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7d6c7e29cf4953a3ce06fc72bc892d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:30.308217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 996/1956] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:29 2022] DELETE /identity/v3/users/0e7d6c7e29cf4953a3ce06fc72bc892d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:30.313691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:30.314002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:30.314306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:30.335765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:30.337276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:30.411530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 961/1957] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:30.411623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:30.413402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:30.477454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755052c-b4a8-4df9-90ed-b3406ae38654 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:30.481465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:30.482188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:30.482472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:30.482760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:30.494270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:30.495934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:30.526461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 997/1958] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:31.536089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:31.538164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:31.550126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59919c5a-7fc9-41d5-97e0-89d2cddd22c1 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:31.554823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:31.555463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:31.555745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:31.556021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] PATH_INFO: `/v3/projects/03e3e485cc4c478ba4babefd06b99cc8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:31.557155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e3e485cc4c478ba4babefd06b99cc8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:31.559137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:31.767819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e3e485cc4c478ba4babefd06b99cc8', 'request_id': 'req-60f22257-239e-4178-b7e5-6b1facab04c8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:31.989182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e3e485cc4c478ba4babefd06b99cc8', 'request_id': 'req-60f22257-239e-4178-b7e5-6b1facab04c8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:31.997658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e3e485cc4c478ba4babefd06b99cc8', 'request_id': 'req-60f22257-239e-4178-b7e5-6b1facab04c8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.027229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] The token cache is being invalidate because project 03e3e485cc4c478ba4babefd06b99cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:32.027611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.028714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.034966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 962/1959] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:31 2022] DELETE /identity/v3/projects/03e3e485cc4c478ba4babefd06b99cc8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:32.036804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:32.050068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c68b76-ab8f-4921-a6c4-244edf85f0f7 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:32.124595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:32.125502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:32.130128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:32.130128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] PATH_INFO: `/v3/users/46e6287f2e954caf85869f107a4cb7b9` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:32.130128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e6287f2e954caf85869f107a4cb7b9)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:32.130128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:32.203184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:32.476915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e6287f2e954caf85869f107a4cb7b9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.571559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e6287f2e954caf85869f107a4cb7b9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.576156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e6287f2e954caf85869f107a4cb7b9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.589772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e6287f2e954caf85869f107a4cb7b9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.597861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e344fc90-4cdd-42f6-bfa0-f5ef8ae53c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e6287f2e954caf85869f107a4cb7b9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:32.604000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 998/1960] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:32 2022] DELETE /identity/v3/users/46e6287f2e954caf85869f107a4cb7b9 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:33.462959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:33.465023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:33.484943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f22257-239e-4178-b7e5-6b1facab04c8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:33.600962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:33.601775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:33.602163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:33.602549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] PATH_INFO: `/v3/projects/c0c6ec12b7d24e029df37f684d337663` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:33.604125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c6ec12b7d24e029df37f684d337663)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:33.606423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:33.781508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c6ec12b7d24e029df37f684d337663', 'request_id': 'req-e130310f-22d0-4e26-b037-3854d2fbe886'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:33.911692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c6ec12b7d24e029df37f684d337663', 'request_id': 'req-e130310f-22d0-4e26-b037-3854d2fbe886'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:33.921287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c6ec12b7d24e029df37f684d337663', 'request_id': 'req-e130310f-22d0-4e26-b037-3854d2fbe886'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:33.940648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] The token cache is being invalidate because project c0c6ec12b7d24e029df37f684d337663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:33.940936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:33.941591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e130310f-22d0-4e26-b037-3854d2fbe886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:33.943438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 963/1961] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:33 2022] DELETE /identity/v3/projects/c0c6ec12b7d24e029df37f684d337663 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:33.948585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:33.949059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:33.949149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:33.970156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:33.971368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:34.034259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 999/1962] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:34.041441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.041735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.042015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.063702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:34.065127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:34.074985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 964/1963] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:34.079755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.090092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64246d36-3250-4eb1-8799-5aae13ac2164 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.099325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.100232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.100761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.101202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.101878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:34.102191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.104323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:34.120477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1000/1964] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:34.125812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.136942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff16bb-b04b-4e57-a726-e0336fadfaf9 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.142836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.147643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.147643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.147643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.147643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.147643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:34.403538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:34.410898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 965/1965] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:34 2022] POST /identity/v3/projects => generated 381 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:34.415356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.425568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a76b8-ddd2-44c1-a9c8-50b17c40c817 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.485440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.486046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.486331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.486612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.487300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.489267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:34.672530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1001/1966] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:34 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:34.677241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.726249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833996a-fe7f-41aa-a947-94ef389a3a35 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.746279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.749453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.750087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.750609 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.752451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.756176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:34.785549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 966/1967] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:34.786012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.797025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ae139-2dea-4052-abaf-ec916eeb8757 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.802874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.803507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.803795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.804073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.804751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.806356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72007303-1cce-4d46-91fb-db1c6bf18924 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:34.820297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1002/1968] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:34.824423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:34.836591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e28a7-9ac5-4685-bd8f-a3760cd485c6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:34.842091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:34.843071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:34.843401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:34.844283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] PATH_INFO: `/v3/projects/e858f9dc6f674948885cd6860a6037ea/users/876fda573a0547068f30d9f65ad93d84/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:34.863061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e858f9dc6f674948885cd6860a6037ea, user_id=876fda573a0547068f30d9f65ad93d84, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:34.866569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.060351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 967/1969] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:34 2022] PUT /identity/v3/projects/e858f9dc6f674948885cd6860a6037ea/users/876fda573a0547068f30d9f65ad93d84/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:35.071591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.072132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.072226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.101847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] MFA Rules not processed for user `876fda573a0547068f30d9f65ad93d84`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:35.103063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:35.194332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1003/1970] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:35.195860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.267465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11279a-f79b-42da-95fa-f597cc7f5790 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.272712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.273348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.273635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.273914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.274565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.276709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.409673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 968/1971] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:35 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:35.413877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.425701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968219d-3dd3-4238-a060-9c5fabd7b37f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.491038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.491782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.492235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.492486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.493238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.495252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.614054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1004/1972] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:35 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:35.620384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.634070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a272f2f-3796-4c8c-81bf-111974d44154 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.638884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.640035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.640186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.640349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.641185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.642864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.656695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 969/1973] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:35.665266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.677421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf330e12-31bc-4ad7-878a-2d1565a8750f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.682758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.683575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.683933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.684316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] PATH_INFO: `/v3/projects/2a02b369e99f4b81bd452d336b1ba24d/users/3ace709ac9f74c65a6450ef48cb6b207/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.703495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a02b369e99f4b81bd452d336b1ba24d, user_id=3ace709ac9f74c65a6450ef48cb6b207, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.706490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.813471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.816126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:35.831790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12de7-8061-49cf-bdca-b26732ab69df admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.837466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.838757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.839029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.839303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] PATH_INFO: `/v3/users/073cf0fb4b9346b1b25ac756da33ff59` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.840500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=073cf0fb4b9346b1b25ac756da33ff59)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.843275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.853620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1005/1974] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:35 2022] PUT /identity/v3/projects/2a02b369e99f4b81bd452d336b1ba24d/users/3ace709ac9f74c65a6450ef48cb6b207/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:35.861350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.938660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628313-7c96-480c-88d2-3f94f60d55bd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.944238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.944943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.945361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.945649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.946320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:35.947946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:35.959802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1006/1975] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:35.965374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:35.979179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250dbf3-7429-446f-a48c-789faaacfbfb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:35.986677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:35.987338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:35.987702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:35.987886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] PATH_INFO: `/v3/projects/2a02b369e99f4b81bd452d336b1ba24d/users/3ace709ac9f74c65a6450ef48cb6b207/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:35.997716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a02b369e99f4b81bd452d336b1ba24d, user_id=3ace709ac9f74c65a6450ef48cb6b207, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:36.003497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a85fa-1f4d-4f99-b5e3-d6dc162c4214 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:36.023633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1007/1976] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:35 2022] PUT /identity/v3/projects/2a02b369e99f4b81bd452d336b1ba24d/users/3ace709ac9f74c65a6450ef48cb6b207/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:36.039445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:36.039740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:36.040051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:36.072499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] MFA Rules not processed for user `3ace709ac9f74c65a6450ef48cb6b207`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:36.073771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:36.172987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1008/1977] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:36.185890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:36.186194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:36.263565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416b489-682e-40b2-9bb8-7179be894376 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:36.265635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:36.266361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:36.266683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:36.267055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:36.276809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:36.279093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880cc37-5ed7-4033-afd9-d79420392643 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:36.289210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1009/1978] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:36.493458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073cf0fb4b9346b1b25ac756da33ff59'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:36.603234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073cf0fb4b9346b1b25ac756da33ff59'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:36.603861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073cf0fb4b9346b1b25ac756da33ff59'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:36.612876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073cf0fb4b9346b1b25ac756da33ff59'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:36.628849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073cf0fb4b9346b1b25ac756da33ff59'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:36.635041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 970/1979] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:35 2022] DELETE /identity/v3/users/073cf0fb4b9346b1b25ac756da33ff59 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:36.639701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:36.639991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:36.640333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:36.659360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:36.660615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:36.730888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1010/1980] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:36.747595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:36.747595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:36.807329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daed1ff-bc7c-4453-8cff-6c8df83b67ad admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:36.811896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:36.812652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:36.812933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:36.813202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:36.823597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:36.826909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:36.839204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 971/1981] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:37.545048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:37.547706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:37.575890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdabdb-959d-42a9-8476-eb57c64d7d4d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:37.588504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:37.589213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:37.589462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:37.589737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] PATH_INFO: `/v3/projects/02e9d040c0564d138328d7399c110fe6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:37.590923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e9d040c0564d138328d7399c110fe6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:37.593804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:37.770347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:37.793504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e9d040c0564d138328d7399c110fe6', 'request_id': 'req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:37.901038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e9d040c0564d138328d7399c110fe6', 'request_id': 'req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:37.917746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e9d040c0564d138328d7399c110fe6', 'request_id': 'req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:37.939096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] The token cache is being invalidate because project 02e9d040c0564d138328d7399c110fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:37.939541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:37.940611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:37.942817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1011/1982] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:37 2022] DELETE /identity/v3/projects/02e9d040c0564d138328d7399c110fe6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:37.947704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:37.964796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb01795-ef93-415a-b595-1548e4e9f94e service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:38.037393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:38.039279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:38.063401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:38.064070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:38.064480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:38.064794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] PATH_INFO: `/v3/users/238d50f859c245f686d9ae7c9e995d4b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:38.066044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] RBAC: Authorizing `identity:delete_user(user_id=238d50f859c245f686d9ae7c9e995d4b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:38.068367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:38.135044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d28ce-7aa6-4e0a-bd0b-0fc5e1abbd13 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:38.141437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:38.142102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:38.142387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:38.142661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] PATH_INFO: `/v3/users/edb3099b8c704a96bc5ed16cc580c880` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:38.143896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb3099b8c704a96bc5ed16cc580c880)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:38.145919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:38.481808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb3099b8c704a96bc5ed16cc580c880'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.500945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238d50f859c245f686d9ae7c9e995d4b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.577174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb3099b8c704a96bc5ed16cc580c880'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.577996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb3099b8c704a96bc5ed16cc580c880'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.601113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb3099b8c704a96bc5ed16cc580c880'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.619574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb3099b8c704a96bc5ed16cc580c880'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.638021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1012/1983] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:38 2022] DELETE /identity/v3/users/edb3099b8c704a96bc5ed16cc580c880 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:38.639506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:38.648055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:38.725653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238d50f859c245f686d9ae7c9e995d4b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.727540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238d50f859c245f686d9ae7c9e995d4b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.745261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238d50f859c245f686d9ae7c9e995d4b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.778639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e21c761-ba1e-42e0-b3e9-deef626e881b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238d50f859c245f686d9ae7c9e995d4b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:38.786896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 972/1984] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:37 2022] DELETE /identity/v3/users/238d50f859c245f686d9ae7c9e995d4b => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:38.788927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:38.789376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:38.789826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:38.798508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b45ed-de08-4d17-a240-3faa3446a625 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:38.825411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:38.835710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:38.943545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ace709ac9f74c65a6450ef48cb6b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a02b369e99f4b81bd452d336b1ba24d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:38.945388 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:38.947465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:38.949273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:38.950713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:38.951030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:38.955614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:39.007616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1013/1985] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:39.009341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 973/1986] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:39.015302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:39.021360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:39.028060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:39.030822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:39.073531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa81df-bf86-45c7-8519-bd57cdac1ba0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:39.090763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ace709ac9f74c65a6450ef48cb6b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a02b369e99f4b81bd452d336b1ba24d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:39.091437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:39.091725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:39.092007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:39.093960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:39.096312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:39.165235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0475-41d7-46c2-a8ad-b773081c17ac None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:39.170804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:39.171639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:39.172110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:39.172657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:39.185812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:39.187784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:39.199870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 974/1987] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:39.470740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1014/1988] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:39 2022] POST /identity/v3/projects => generated 353 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:39.475603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:39.513710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1186f-20c1-44aa-8904-e50a270faac4 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:39.630096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ace709ac9f74c65a6450ef48cb6b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a02b369e99f4b81bd452d336b1ba24d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:39.633285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:39.633285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:39.633285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:39.633285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:39.633285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:39.634311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:39.649288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 975/1989] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:39.706564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:39.738797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0f54-4c02-48b0-9c30-d4dd2a93f1e0 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:39.745774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ace709ac9f74c65a6450ef48cb6b207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a02b369e99f4b81bd452d336b1ba24d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:39.746594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:39.749282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:39.749282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] PATH_INFO: `/v3/projects/79d5bd60e9dc4a969578806fcb04400f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:39.749282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79d5bd60e9dc4a969578806fcb04400f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:39.751872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:39.952920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:39.975815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d5bd60e9dc4a969578806fcb04400f', 'request_id': 'req-ee29cee4-52f6-475e-b515-2088f38099e4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.056100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:40.058300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:40.146906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d5bd60e9dc4a969578806fcb04400f', 'request_id': 'req-ee29cee4-52f6-475e-b515-2088f38099e4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.156589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d5bd60e9dc4a969578806fcb04400f', 'request_id': 'req-ee29cee4-52f6-475e-b515-2088f38099e4'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.171911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] The token cache is being invalidate because project 79d5bd60e9dc4a969578806fcb04400f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:40.172481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.173381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.175125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1015/1990] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:39 2022] DELETE /identity/v3/projects/79d5bd60e9dc4a969578806fcb04400f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:40.190303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6d23-536c-4e94-a7e6-c25c096b129d tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:40.260575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:40.263548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:40.356419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:40.357391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:40.357880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:40.359016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] PATH_INFO: `/v3/projects/7f9e49ebc1e145d4aa09ff057606e9f1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:40.361096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e49ebc1e145d4aa09ff057606e9f1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:40.366189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:40.391178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cee4-52f6-475e-b515-2088f38099e4 tempest-VolumeQuotaClassesTest-317554567 tempest-VolumeQuotaClassesTest-317554567-project-admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:40.401801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:40.402649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:40.403360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:40.420072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] PATH_INFO: `/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:40.420072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c59b61a21a4aff9264c1b6deec1e3d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:40.420072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:40.587622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c59b61a21a4aff9264c1b6deec1e3d', 'request_id': 'req-70892dcd-5f18-4a3c-a224-675f3a68e26a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.587813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e49ebc1e145d4aa09ff057606e9f1', 'request_id': 'req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.782866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e49ebc1e145d4aa09ff057606e9f1', 'request_id': 'req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.794782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e49ebc1e145d4aa09ff057606e9f1', 'request_id': 'req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.808406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] The token cache is being invalidate because project 7f9e49ebc1e145d4aa09ff057606e9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:40.808792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.809382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.811904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 976/1991] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:40 2022] DELETE /identity/v3/projects/7f9e49ebc1e145d4aa09ff057606e9f1 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:40.815820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:40.817673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:40.886998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42b96d-bf7d-4f39-9cf8-78861e4e6c7e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:40.949554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:40.950354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:40.950697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:40.950946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] PATH_INFO: `/v3/users/774612e246ef47ad8dd3f4f1b05c7ac3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:40.953052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774612e246ef47ad8dd3f4f1b05c7ac3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:40.954958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:40.972321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c59b61a21a4aff9264c1b6deec1e3d', 'request_id': 'req-70892dcd-5f18-4a3c-a224-675f3a68e26a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:40.981386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c59b61a21a4aff9264c1b6deec1e3d', 'request_id': 'req-70892dcd-5f18-4a3c-a224-675f3a68e26a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.009955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] The token cache is being invalidate because project c4c59b61a21a4aff9264c1b6deec1e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:41.010257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.010913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-70892dcd-5f18-4a3c-a224-675f3a68e26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.012405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1016/1992] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:40 2022] DELETE /identity/v3/projects/c4c59b61a21a4aff9264c1b6deec1e3d => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:41.020992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77bad-7864-4e9e-90ac-c12fe6454979 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.021277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77bad-7864-4e9e-90ac-c12fe6454979 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.021553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f77bad-7864-4e9e-90ac-c12fe6454979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.044024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d6f77bad-7864-4e9e-90ac-c12fe6454979 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:41.045499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d6f77bad-7864-4e9e-90ac-c12fe6454979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:41.054179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1017/1993] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:41.069838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.069838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.069838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.087876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:41.089134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:41.098541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1018/1994] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:41.103131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.114033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e262-b10b-4f57-89b0-47f902a0c3a2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.119993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.120672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.121034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.121313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.121984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:41.122295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.124552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.138085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1019/1995] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:10:41.142882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.156731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83094-e681-4241-8708-41d87ebea9bb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.166211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.167578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.168420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.169323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.171515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.176284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.371264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774612e246ef47ad8dd3f4f1b05c7ac3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.406265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1020/1996] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:41 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:41.411121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.468878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774612e246ef47ad8dd3f4f1b05c7ac3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.469741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774612e246ef47ad8dd3f4f1b05c7ac3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.481478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774612e246ef47ad8dd3f4f1b05c7ac3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.499594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774612e246ef47ad8dd3f4f1b05c7ac3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:41.507508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 977/1997] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:40 2022] DELETE /identity/v3/users/774612e246ef47ad8dd3f4f1b05c7ac3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:41.508637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.510727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:41.525192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a81df8-f47d-4d5f-a260-39375af5bd72 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.631723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88a653-5d5b-465e-a0a7-e157ab8e82a9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.636784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.637505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.637815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.638274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.639404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.639639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.640554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.640853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.641143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] PATH_INFO: `/v3/users/876fda573a0547068f30d9f65ad93d84` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.641951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.645632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=876fda573a0547068f30d9f65ad93d84)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.650372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.801844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1021/1998] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:41 2022] POST /identity/v3/users => generated 289 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:41.806708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.808489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:41.824357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53448-ddd9-4cf5-a02c-57e48f8804f8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.830572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.831251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.831566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.831844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.832784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.834556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.847248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1022/1999] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:41.852461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.866454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b57e4-398a-4487-adfb-f24f63f4ad21 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.874010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.874688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.875041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.875324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.875972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.877629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.888746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1023/2000] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:41.893707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:41.903721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b85bc3-d392-4320-8236-9ac41b23efe5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:41.909829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:41.910504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:41.910786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:41.911092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] PATH_INFO: `/v3/projects/39711e2df4b146bda1f12a23e8ffd772/users/3159184937c2450387039c5ede1a2a49/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:41.930152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39711e2df4b146bda1f12a23e8ffd772, user_id=3159184937c2450387039c5ede1a2a49, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:41.932887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6694877-95fe-4446-a2e0-3e1b566235e2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:41.985931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876fda573a0547068f30d9f65ad93d84'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.099302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1024/2001] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:41 2022] PUT /identity/v3/projects/39711e2df4b146bda1f12a23e8ffd772/users/3159184937c2450387039c5ede1a2a49/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:42.110182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.110474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.110754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.139699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] MFA Rules not processed for user `3159184937c2450387039c5ede1a2a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:42.141104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.178138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876fda573a0547068f30d9f65ad93d84'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.178773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876fda573a0547068f30d9f65ad93d84'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.187269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876fda573a0547068f30d9f65ad93d84'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.207823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-40b39198-e0fd-4c75-9cbd-f2db90d063ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876fda573a0547068f30d9f65ad93d84'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.214051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 978/2002] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:41 2022] DELETE /identity/v3/users/876fda573a0547068f30d9f65ad93d84 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:42.215314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1025/2003] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:42.219197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.219498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.219782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.230469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:42.233820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.245742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:42.247159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.344539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 979/2004] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:42.345679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:42.347515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.397692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3a446-3a92-4c07-8d05-1b1a1e7b68dc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:42.405198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a78828-4d4a-4d16-9573-b125fd861c8f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:42.427829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:42.428598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.430124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.430606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] PATH_INFO: `/v3/projects/0e0a0bbec14f4bb18ab9240da5d1052b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.436226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0a0bbec14f4bb18ab9240da5d1052b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:42.452197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:42.502078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:42.502891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.503189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.503462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.597324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:42.598937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:42.610417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1026/2005] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:42.613308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:42.614702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.690999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0a0bbec14f4bb18ab9240da5d1052b', 'request_id': 'req-3c78760a-17ad-48be-8855-c50cb8d9b823'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.724399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25444-e4ad-400e-8e72-65e8d5db9987 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:42.803151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0a0bbec14f4bb18ab9240da5d1052b', 'request_id': 'req-3c78760a-17ad-48be-8855-c50cb8d9b823'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.818236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0a0bbec14f4bb18ab9240da5d1052b', 'request_id': 'req-3c78760a-17ad-48be-8855-c50cb8d9b823'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.830302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:42.831761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.832225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.832873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.840877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] The token cache is being invalidate because project 0e0a0bbec14f4bb18ab9240da5d1052b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:42.841300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.842797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:42.845605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 980/2006] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:42 2022] DELETE /identity/v3/projects/0e0a0bbec14f4bb18ab9240da5d1052b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:42.849694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:42.851406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:42.959032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:42.960669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:42.976778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78760a-17ad-48be-8855-c50cb8d9b823 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:42.979817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1027/2007] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:42.988998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:42.989979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:42.990274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:42.990563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] PATH_INFO: `/v3/users/30af92bc02c249acafd8b9eed9b14e33` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:42.991935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30af92bc02c249acafd8b9eed9b14e33)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:42.996316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:43.477668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30af92bc02c249acafd8b9eed9b14e33'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:43.661755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30af92bc02c249acafd8b9eed9b14e33'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:43.662899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30af92bc02c249acafd8b9eed9b14e33'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:43.679622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30af92bc02c249acafd8b9eed9b14e33'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:43.702897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30af92bc02c249acafd8b9eed9b14e33'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:43.714959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 981/2008] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:42 2022] DELETE /identity/v3/users/30af92bc02c249acafd8b9eed9b14e33 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:43.726204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:43.728981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:43.744095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6f52e-80ca-4324-a069-7a40582a3a76 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:43.828308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:43.829018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:43.829325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:43.829608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] PATH_INFO: `/v3/projects/e858f9dc6f674948885cd6860a6037ea` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:43.831073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e858f9dc6f674948885cd6860a6037ea)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:43.833132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:43.993253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e858f9dc6f674948885cd6860a6037ea', 'request_id': 'req-9674367a-d299-4cb4-b2c0-37691332c47f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.190937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e858f9dc6f674948885cd6860a6037ea', 'request_id': 'req-9674367a-d299-4cb4-b2c0-37691332c47f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.215569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e858f9dc6f674948885cd6860a6037ea', 'request_id': 'req-9674367a-d299-4cb4-b2c0-37691332c47f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.229842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] The token cache is being invalidate because project e858f9dc6f674948885cd6860a6037ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:44.230065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.230660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.236440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1028/2009] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:43 2022] DELETE /identity/v3/projects/e858f9dc6f674948885cd6860a6037ea => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:44.237606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:44.239256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:44.272021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70047-a18e-4a08-84ca-5ce1e657a4b3 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:44.380575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:44.384426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:44.384426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:44.384426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] PATH_INFO: `/v3/users/3ace709ac9f74c65a6450ef48cb6b207` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:44.387393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ace709ac9f74c65a6450ef48cb6b207)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:44.389658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:44.535786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:44.685334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:44.687379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:44.714852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674367a-d299-4cb4-b2c0-37691332c47f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:44.725157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:44.725851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:44.726232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:44.727284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] PATH_INFO: `/v3/projects/602077aa018840cfb4bb38ae4faf82c4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:44.728919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602077aa018840cfb4bb38ae4faf82c4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:44.741318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:44.806576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ace709ac9f74c65a6450ef48cb6b207'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:44.999772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ace709ac9f74c65a6450ef48cb6b207'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.001169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ace709ac9f74c65a6450ef48cb6b207'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.011928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602077aa018840cfb4bb38ae4faf82c4', 'request_id': 'req-148f1527-4c39-410a-b7a2-19ba817bf204'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.015224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ace709ac9f74c65a6450ef48cb6b207'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.055209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ba62afa-709b-48bb-a819-e273811377a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ace709ac9f74c65a6450ef48cb6b207'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.067653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 982/2010] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:44 2022] DELETE /identity/v3/users/3ace709ac9f74c65a6450ef48cb6b207 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:45.147175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602077aa018840cfb4bb38ae4faf82c4', 'request_id': 'req-148f1527-4c39-410a-b7a2-19ba817bf204'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.161107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602077aa018840cfb4bb38ae4faf82c4', 'request_id': 'req-148f1527-4c39-410a-b7a2-19ba817bf204'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.201734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] The token cache is being invalidate because project 602077aa018840cfb4bb38ae4faf82c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:45.202606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.204398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-148f1527-4c39-410a-b7a2-19ba817bf204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:45.207074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1029/2011] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:44 2022] DELETE /identity/v3/projects/602077aa018840cfb4bb38ae4faf82c4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:45.215631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.216197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.218455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.245832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:45.247287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:45.392764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 983/2012] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:45.407110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.407521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.407899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.437035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:45.438338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:45.447810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1030/2013] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:45.452425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:45.469804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3cece-3419-458a-b267-5601ce1d3888 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:45.475232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:45.477065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.478909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.478909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.478909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:45.478909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:45.480258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:45.500378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 984/2014] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:45.502362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:45.512569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc2e30-c037-4737-823f-8be4993a2382 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:45.521914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:45.522905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.523191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.523605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.524429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:45.526712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:45.682083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1031/2015] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:45 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:45.689529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:45.702573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e6ceb-f2d0-4b7d-b50f-4511ac3493dc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:45.790202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:45.790973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.791372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.792896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.793790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:45.797210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:45.905660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:45.908132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:45.934780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48c07-cb09-40fc-b31e-b097773b6211 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:45.949637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:45.949829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.950451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.950874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] PATH_INFO: `/v3/projects/2a02b369e99f4b81bd452d336b1ba24d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.956897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 985/2016] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:45 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:45.957153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a02b369e99f4b81bd452d336b1ba24d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:45.957153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:45.959915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:45.977103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33193f-8c26-4d03-892f-c01050339f92 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:45.983587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:45.983587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:45.984036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:45.984222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:45.984981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:45.986866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.000392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 986/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:46.007061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.023587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b786f3-36cb-4765-a910-1181b49496ef admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.030631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.031476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.031855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.032205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.033024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.034747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.047010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 987/2018] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:46.051879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.064760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2224-3602-4af5-a23f-6d42e13ca930 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.069915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.070601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.070884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.071164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] PATH_INFO: `/v3/projects/c9b0e21b82814c3d8cd5294694aa5f8a/users/c79a24ec2bb64464877cfc10b12b609a/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.088686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b0e21b82814c3d8cd5294694aa5f8a, user_id=c79a24ec2bb64464877cfc10b12b609a, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.091359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d2b67-d6dd-47ac-8440-c397a3e4b8aa admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.228117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 988/2019] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:46 2022] PUT /identity/v3/projects/c9b0e21b82814c3d8cd5294694aa5f8a/users/c79a24ec2bb64464877cfc10b12b609a/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:46.234813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a02b369e99f4b81bd452d336b1ba24d', 'request_id': 'req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:46.244250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.244651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.245012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.284695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] MFA Rules not processed for user `c79a24ec2bb64464877cfc10b12b609a`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:46.285917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:46.336709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a02b369e99f4b81bd452d336b1ba24d', 'request_id': 'req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:46.345507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a02b369e99f4b81bd452d336b1ba24d', 'request_id': 'req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:46.360331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] The token cache is being invalidate because project 2a02b369e99f4b81bd452d336b1ba24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:46.360987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:46.361855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4f0c1b28-a1e4-4e48-aed5-24a8dda62460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:46.363868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1032/2020] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:45 2022] DELETE /identity/v3/projects/2a02b369e99f4b81bd452d336b1ba24d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:46.366900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 989/2021] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:46.369112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f54c-2672-4696-a0aa-8651d451449a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.369408 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f54c-2672-4696-a0aa-8651d451449a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.369741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8f54c-2672-4696-a0aa-8651d451449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.384217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.386553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:46.394567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-35e8f54c-2672-4696-a0aa-8651d451449a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:46.395668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-35e8f54c-2672-4696-a0aa-8651d451449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:46.505517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5624-764d-4fda-a0b7-46cb5ec84108 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.506234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1033/2022] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:46.509872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.510732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.511165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.511953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.514743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:46.521804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.522283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.522784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.535043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.537032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.553759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:46.554331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 990/2023] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:46.556123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:46.570981 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1034/2024] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:46.572781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.586010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b918-4b9a-4a18-be0d-ef2764c93f5f service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.590856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.591466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.591796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.592111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.593578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:46.593578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.594693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.608778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 991/2025] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:46.614599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.636888 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff0f03-758e-4946-a80d-ef5b9bae7782 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.638417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.639248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.639650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.639928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.640746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.643121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:46.793304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1035/2026] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:46 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:46.798900 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:46.813012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:46.818555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9bc79-01cc-4866-8860-37adc11be4dc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:46.916957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:46.936141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:46.936912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:46.937247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:46.937447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:46.938117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:46.940985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:47.082419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 992/2027] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:46 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:47.086742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:47.099866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3c8f9-8d26-4cd9-97b1-a787a082d488 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:47.104566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:47.105199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.105482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.105756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.106413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:47.108434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:47.118942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1036/2028] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:47.123132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:47.134422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f690fb-ebc2-43c1-811b-2616cb0fb116 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:47.140722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:47.141196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.141487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.141767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.142432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:47.144088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe020-e0d3-4bd1-ab55-74610b6563ce admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:47.157065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 993/2029] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:47.161605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:47.173691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753037f-705e-463c-8cb3-36d77f9144c0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:47.178449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:47.179116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.179401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.179681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] PATH_INFO: `/v3/projects/13bd8685b31a438b895ceefcd2aec67a/users/eec5cc7fad4d411689b95020188aa832/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.210017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bd8685b31a438b895ceefcd2aec67a, user_id=eec5cc7fad4d411689b95020188aa832, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:47.212800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:47.328139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1037/2030] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:47 2022] PUT /identity/v3/projects/13bd8685b31a438b895ceefcd2aec67a/users/eec5cc7fad4d411689b95020188aa832/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:47.341188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.341522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.341728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.374714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] MFA Rules not processed for user `eec5cc7fad4d411689b95020188aa832`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:47.375983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:47.453156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 994/2031] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:47.458164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:47.564437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641650-8dc6-4a7c-a738-63572dc0d948 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:47.588904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:47.590433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.590895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.591329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.592402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:47.595492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:47.816639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1038/2032] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:47 2022] POST /identity/v3/projects => generated 381 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:47.818880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:47.838375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829920dd-d64f-469c-b7b4-3ce6f2b99ad8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:47.947642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:47.947991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:47.948488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:47.948948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:47.949755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:47.952061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.153152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 995/2033] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:47 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:48.159203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:48.173228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da51a0-21c2-4158-a961-470211ae04c1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:48.179092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:48.179855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.182627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.182627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.182627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:48.183648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.205395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1039/2034] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:48.210444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:48.222148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9b1b5-d7f5-4aa9-b90f-b7b68aa98e36 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:48.227832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:48.228545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.228840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.229117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] PATH_INFO: `/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27/users/7165e4f4f67243e88d9ec7fc55f7f7bd/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.252363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1ca78a23444bd4b5bdea82c1f50d27, user_id=7165e4f4f67243e88d9ec7fc55f7f7bd, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:48.257892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.392750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 996/2035] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:48 2022] PUT /identity/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27/users/7165e4f4f67243e88d9ec7fc55f7f7bd/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:48.397081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:48.410291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fcfa1-d608-4de9-96bc-50e33b3f3be8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:48.472711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:48.473331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.473615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.473894 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.474545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:48.476160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c713fb9-7a96-4e7e-a721-df448ff66b56 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.487605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1040/2036] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:48.491938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:48.502345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ccb5-f298-4916-b16c-48302cafe260 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:48.509107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:48.509107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.509107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.509107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] PATH_INFO: `/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27/users/7165e4f4f67243e88d9ec7fc55f7f7bd/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.510207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1ca78a23444bd4b5bdea82c1f50d27, user_id=7165e4f4f67243e88d9ec7fc55f7f7bd, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:48.512815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.523893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 997/2037] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:48 2022] PUT /identity/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27/users/7165e4f4f67243e88d9ec7fc55f7f7bd/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:48.536158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.536448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.536769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.568012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] MFA Rules not processed for user `7165e4f4f67243e88d9ec7fc55f7f7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:48.569407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:48.662555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1041/2038] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:48.673938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:48.675623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:48.752729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096198f-a49a-40c4-af32-8cec6c32b0bd admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:48.757287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:48.757938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:48.758222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:48.758499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:48.771441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:48.772972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695823a-3d5a-401a-9081-a5799e195a4f service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:48.787104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 998/2039] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:49.769385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:49.861512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8e2b-2343-4bf7-8d7a-53ce938a4a8f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:49.872667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:49.873586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:49.874124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:49.874581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] PATH_INFO: `/v3/users/eec5cc7fad4d411689b95020188aa832` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:49.875955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec5cc7fad4d411689b95020188aa832)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:49.878662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:50.119138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec5cc7fad4d411689b95020188aa832'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:50.271450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec5cc7fad4d411689b95020188aa832'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:50.272109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec5cc7fad4d411689b95020188aa832'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:50.289930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec5cc7fad4d411689b95020188aa832'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:50.300298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec5cc7fad4d411689b95020188aa832'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:50.309864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1042/2040] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:49 2022] DELETE /identity/v3/users/eec5cc7fad4d411689b95020188aa832 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:50.317591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:50.321535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:50.321535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:50.341877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:50.343131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:50.463844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 999/2041] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:50.478091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:50.482503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:50.613758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2986c-1658-4041-be54-d933daed679d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:50.632311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:50.633990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:50.634952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:50.635760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:50.662811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:50.663398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:50.683155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1043/2042] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:51.208985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:51.218234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:51.220002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:51.242585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d771-cfdb-475f-ab8f-849f4f4f7522 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:51.247977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:51.249118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:51.253212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:51.253212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] PATH_INFO: `/v3/projects/13bd8685b31a438b895ceefcd2aec67a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:51.253212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bd8685b31a438b895ceefcd2aec67a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:51.253212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:51.378302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:51.454711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bd8685b31a438b895ceefcd2aec67a', 'request_id': 'req-7db63fa1-95be-4aad-b80d-ef03bee7236e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:51.563068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bd8685b31a438b895ceefcd2aec67a', 'request_id': 'req-7db63fa1-95be-4aad-b80d-ef03bee7236e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:51.579010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bd8685b31a438b895ceefcd2aec67a', 'request_id': 'req-7db63fa1-95be-4aad-b80d-ef03bee7236e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:51.607378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] The token cache is being invalidate because project 13bd8685b31a438b895ceefcd2aec67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:51.608495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:51.609589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:51.614911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1000/2043] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:51 2022] DELETE /identity/v3/projects/13bd8685b31a438b895ceefcd2aec67a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:51.618632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:51.633505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4e5b-9967-42b6-a8ec-f8fc9f42d00a service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:51.714263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:51.714945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:51.715228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:51.715505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] PATH_INFO: `/v3/users/7165e4f4f67243e88d9ec7fc55f7f7bd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:51.717009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7165e4f4f67243e88d9ec7fc55f7f7bd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:51.719155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:52.145079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7165e4f4f67243e88d9ec7fc55f7f7bd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:52.249514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7165e4f4f67243e88d9ec7fc55f7f7bd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:52.250354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7165e4f4f67243e88d9ec7fc55f7f7bd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:52.269913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7165e4f4f67243e88d9ec7fc55f7f7bd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:52.277808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-049dedab-5671-4ab0-94d7-516f736d6480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7165e4f4f67243e88d9ec7fc55f7f7bd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:52.285289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1044/2044] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:51 2022] DELETE /identity/v3/users/7165e4f4f67243e88d9ec7fc55f7f7bd => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:52.920742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:52.922303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:52.950187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63fa1-95be-4aad-b80d-ef03bee7236e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:53.034054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:53.035485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.036931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.037424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] PATH_INFO: `/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.038718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1ca78a23444bd4b5bdea82c1f50d27)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:53.040754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:53.287396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1ca78a23444bd4b5bdea82c1f50d27', 'request_id': 'req-94a012fc-e366-4bff-8be7-016868e37340'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:53.434142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1ca78a23444bd4b5bdea82c1f50d27', 'request_id': 'req-94a012fc-e366-4bff-8be7-016868e37340'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:53.442012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1ca78a23444bd4b5bdea82c1f50d27', 'request_id': 'req-94a012fc-e366-4bff-8be7-016868e37340'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:53.454897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] The token cache is being invalidate because project da1ca78a23444bd4b5bdea82c1f50d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:53.455187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:53.455856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-94a012fc-e366-4bff-8be7-016868e37340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:53.457707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1001/2045] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:52 2022] DELETE /identity/v3/projects/da1ca78a23444bd4b5bdea82c1f50d27 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:53.462630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.463332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.463332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.485475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:53.492358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:53.561757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1045/2046] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:53.570665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.570965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.571244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.594502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:53.598144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:53.604261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1002/2047] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:53.611515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:53.619995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac1b7-e8be-45b9-80f0-d588dfce8f66 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:53.625655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:53.626346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.626635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.626915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.627613 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:53.627924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:53.629608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:53.643741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1046/2048] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:10:53.649171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:53.662576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeacad4-132e-4898-a8a3-e28c1fc04db0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:53.667671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:53.668300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.668623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.668919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.669566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:53.673363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:53.797388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1003/2049] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:53 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:53.801932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:53.823047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459b714-cc01-44aa-b412-d0f13f46ec87 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:53.897499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:53.898119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:53.898404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:53.898680 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:53.899407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:53.901469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.081618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1047/2050] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:53 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:54.085826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.100181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974db7-d32c-4c39-90ec-f6b47ddd5551 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.105829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.106611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.106991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.107375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.108151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.109987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.122282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1004/2051] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:54.127730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.138441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e22-493b-4600-bfeb-f7efca03c4b1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.145565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.146347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.146738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.147087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.147962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.150243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00b19-2fd3-4d86-a925-f1a547dd5ff1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.163788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1048/2052] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:54.169707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.179888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe3d1e-71f8-4fa4-a009-19709e9761b1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.185063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.186100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.186486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.187054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] PATH_INFO: `/v3/projects/e4b2d4375dd84e3081ccbdd638265211/users/545a4ad0f33d49e9ba9099e836f62fab/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.215491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b2d4375dd84e3081ccbdd638265211, user_id=545a4ad0f33d49e9ba9099e836f62fab, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.219882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.268639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:54.354239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1005/2053] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:54 2022] PUT /identity/v3/projects/e4b2d4375dd84e3081ccbdd638265211/users/545a4ad0f33d49e9ba9099e836f62fab/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:54.365826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.366117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.366413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.396310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] MFA Rules not processed for user `545a4ad0f33d49e9ba9099e836f62fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:54.397560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:54.471391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1049/2054] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:54.484319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.549642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a047d7-31e8-48e4-8f38-1786ea8386c1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.554467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.555082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.555362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.555637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.556288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.558248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.614048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:54.751101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1006/2055] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:54 2022] POST /identity/v3/projects => generated 375 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:54.752845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.766045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93481f6-acec-4b74-a334-9250beb08e12 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.832869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.833494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.833775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.834047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.834702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.836739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:54.955366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1050/2056] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:54 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:54.959570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:54.974018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6227155-d66d-46fa-8e9c-572a7889e3fd admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:54.979000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:54.979744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:54.980031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:54.980312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:54.982154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:54.984684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:55.001984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1007/2057] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:55.006983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:55.017703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2e40-5ab1-49c4-9073-d07991b24a44 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:55.023593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:55.024270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:55.024577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:55.025037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] PATH_INFO: `/v3/projects/08bd615f8a964206869b92f5f8623a58/users/f5a070cbcb2f4ca990533056ddd84752/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:55.042902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bd615f8a964206869b92f5f8623a58, user_id=f5a070cbcb2f4ca990533056ddd84752, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:55.047166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:55.182594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1051/2058] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:55 2022] PUT /identity/v3/projects/08bd615f8a964206869b92f5f8623a58/users/f5a070cbcb2f4ca990533056ddd84752/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:55.187237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:55.197669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e8958-d355-4842-8232-db334b3894de admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:55.260843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:55.261453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:55.261731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:55.262003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:55.262648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:55.264244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3d9a8-95b4-4279-a5fb-17f0baf17694 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:55.274347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1008/2059] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:10:55.278587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:55.289909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61728ab-9221-4144-88dd-29d31eab9be3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:55.296412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:55.297117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:55.297402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:55.297686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] PATH_INFO: `/v3/projects/08bd615f8a964206869b92f5f8623a58/users/f5a070cbcb2f4ca990533056ddd84752/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:55.299657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bd615f8a964206869b92f5f8623a58, user_id=f5a070cbcb2f4ca990533056ddd84752, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:55.302384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:55.314560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1052/2060] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:55 2022] PUT /identity/v3/projects/08bd615f8a964206869b92f5f8623a58/users/f5a070cbcb2f4ca990533056ddd84752/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:55.324797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:55.325222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:55.325564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:55.361641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] MFA Rules not processed for user `f5a070cbcb2f4ca990533056ddd84752`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:55.362885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:55.444544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1009/2061] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:55.456077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:55.457950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:55.521747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03195b8-8b74-4f37-863e-34a4157a8ef8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:55.525718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:55.531860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:55.531860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:55.531860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:55.592264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:55.593734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00203d2f-376b-445b-a291-2c4c62c3c10e service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:55.602781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1053/2062] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:56.565856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:56.567309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:56.666541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef377cbe-d941-4cb1-82ef-03c3e823712f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:56.672092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:56.676940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:56.676940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:56.676940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] PATH_INFO: `/v3/users/c79a24ec2bb64464877cfc10b12b609a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:56.676940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79a24ec2bb64464877cfc10b12b609a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:56.676940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:56.986081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79a24ec2bb64464877cfc10b12b609a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:57.096376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79a24ec2bb64464877cfc10b12b609a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:57.097089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79a24ec2bb64464877cfc10b12b609a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:57.107189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79a24ec2bb64464877cfc10b12b609a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:57.123325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79a24ec2bb64464877cfc10b12b609a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:57.130483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1010/2063] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:56 2022] DELETE /identity/v3/users/c79a24ec2bb64464877cfc10b12b609a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:57.135199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:57.135724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:57.135724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:57.159610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:57.160899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:57.234253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1054/2064] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:57.244041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:57.245597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:57.319888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9cca1-2821-4a52-969d-5c6d6f9e2a9b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:57.334636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:57.334636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:57.334636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:57.334636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:57.336490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:57.337931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:57.349604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1011/2065] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:57.490943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:57.492404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:57.506237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a30fa-8230-4725-964e-6dc1b234e9f8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:57.536129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:57.536838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:57.537127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:57.537404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] PATH_INFO: `/v3/users/7c66658a481f40d5b32f996794ec7d3b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:57.538878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c66658a481f40d5b32f996794ec7d3b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:57.541871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:57.839371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:57.841052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:57.876967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb5d60-086a-4f90-87e4-2468c3ffd074 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:57.890872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:57.891600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:57.891754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:57.892037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] PATH_INFO: `/v3/projects/c9b0e21b82814c3d8cd5294694aa5f8a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:57.894358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b0e21b82814c3d8cd5294694aa5f8a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:57.896526 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:57.900983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c66658a481f40d5b32f996794ec7d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.077385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c66658a481f40d5b32f996794ec7d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.077940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c66658a481f40d5b32f996794ec7d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.094166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c66658a481f40d5b32f996794ec7d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.101558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1e51f655-25a2-4f26-977d-04a1bab07867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c66658a481f40d5b32f996794ec7d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.109386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1055/2066] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:57 2022] DELETE /identity/v3/users/7c66658a481f40d5b32f996794ec7d3b => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:58.113864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.114147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.114426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.141752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:58.143703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.191493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b0e21b82814c3d8cd5294694aa5f8a', 'request_id': 'req-48800827-e6b9-4863-aaab-3b329b5a7524'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.224997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1056/2067] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:58.236477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:58.237992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.303821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd865d-e8ec-4aeb-bf7d-1f79e436c21e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:58.329214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:58.359514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:58.360143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.360428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.360911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.385428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b0e21b82814c3d8cd5294694aa5f8a', 'request_id': 'req-48800827-e6b9-4863-aaab-3b329b5a7524'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.392852 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b0e21b82814c3d8cd5294694aa5f8a', 'request_id': 'req-48800827-e6b9-4863-aaab-3b329b5a7524'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.406760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] The token cache is being invalidate because project c9b0e21b82814c3d8cd5294694aa5f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:58.407057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.407923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48800827-e6b9-4863-aaab-3b329b5a7524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:58.409492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1012/2068] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:57 2022] DELETE /identity/v3/projects/c9b0e21b82814c3d8cd5294694aa5f8a => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:58.414535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.414887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.415344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.435151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:58.445221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90bedc-3bbb-4285-bcd0-0041b10ddae6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:58.445393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:58.445393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.448092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1057/2069] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:58.449629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1013/2070] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:58.459001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.459319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.459717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.486987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:58.489064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.498061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1058/2071] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:58.502491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:58.512709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132771f1-94f9-456d-ab09-36a2310bc69f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:58.518599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:58.519224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.519623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.519758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.520448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:10:58.520807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:58.522415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:58.537887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1014/2072] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:10:58.541222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:58.552302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbf962-19d8-4591-8cb7-3dd7ec29ae5a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:58.563010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:58.563792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.563906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.564098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.564839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:58.566758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:58.710508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:58.738080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1059/2073] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:58.738249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:58.756149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320277fd-4f91-477e-8eae-022160907692 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:58.879382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:58.880604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.881114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.882642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.884216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:58.888963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.076843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1015/2074] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:10:59.078607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.089669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421f44-5f9f-4674-9506-912f2bedecc9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.095852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.096480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.096798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.097072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.097722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.099340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.115457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1060/2075] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:59.119289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.132183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487288-2ecf-44bf-bf39-9e2182794f5a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.137608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.138311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.139624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.139833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.140782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.142482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.154359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1016/2076] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:10:59.159225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.170173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cc756-9495-404d-8cbe-06aa7610612d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.174726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.175440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.175720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.176204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] PATH_INFO: `/v3/projects/5f3e0209c169444db7790db8e1e958df/users/c558eabf556241bebe3d552a680f9940/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.195063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3e0209c169444db7790db8e1e958df, user_id=c558eabf556241bebe3d552a680f9940, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.198089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627991da-d5c6-446b-b0cf-650f5fa2d6d3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.247698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.253930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:59.287043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ad1a0-add5-411c-9365-9b712852d60a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.298751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.300092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.300891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.301458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] PATH_INFO: `/v3/projects/bdd490aad2b94c81b787672ff6b0cf5b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.303024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd490aad2b94c81b787672ff6b0cf5b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.305584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.388133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1061/2077] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:10:59 2022] PUT /identity/v3/projects/5f3e0209c169444db7790db8e1e958df/users/c558eabf556241bebe3d552a680f9940/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:10:59.401684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.402703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.403627 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.434753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] MFA Rules not processed for user `c558eabf556241bebe3d552a680f9940`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:59.438152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:59.532719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1062/2078] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:10:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:10:59.537023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.557261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd490aad2b94c81b787672ff6b0cf5b', 'request_id': 'req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:59.618843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d38a-3350-4c2d-a3cf-8447e2a73119 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.683932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.684612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.684900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.685177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.686407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.688473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.719387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd490aad2b94c81b787672ff6b0cf5b', 'request_id': 'req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:59.725801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd490aad2b94c81b787672ff6b0cf5b', 'request_id': 'req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:59.742177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] The token cache is being invalidate because project bdd490aad2b94c81b787672ff6b0cf5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:10:59.742475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:59.743410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:10:59.745489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1017/2079] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:10:59 2022] DELETE /identity/v3/projects/bdd490aad2b94c81b787672ff6b0cf5b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:10:59.756958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.758567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:59.780275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2037f0-fbf9-47ae-a77b-be40d9287a0a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.790797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.791629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.792411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.793078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] PATH_INFO: `/v3/users/60f12698cccc44fb9a7758503d7f569d` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.795582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f12698cccc44fb9a7758503d7f569d)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:59.798960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:59.907031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1063/2080] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:10:59.907031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:59.907031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:59.990482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4954-af3e-4849-b8d6-686a6438ced6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:59.995415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:59.996112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:59.996404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:59.996728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:59.997421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.000474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.195390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1064/2081] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:10:59 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:00.199097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.209624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a306e-52c1-4f26-a2fd-5b4c404b22a5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.214279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.214925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.215205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.215479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.216155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.218759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.229377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1065/2082] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:00.238869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.251827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b0cf-5eae-44d5-8759-22cc501ad9d9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.256595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.257199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.257478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.257751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.258393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.259990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.270637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1066/2083] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:00.274733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.284426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd13ea-04cd-4db0-a430-5214aa3aa414 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.289027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.289663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.289943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.290219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] PATH_INFO: `/v3/projects/b263d884af944fdc867ae745f2d6e965/users/9ebb7fa8eafc4485bd7ee670d9050a57/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.307867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b263d884af944fdc867ae745f2d6e965, user_id=9ebb7fa8eafc4485bd7ee670d9050a57, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.311079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.378338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f12698cccc44fb9a7758503d7f569d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:00.525087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1067/2084] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:00 2022] PUT /identity/v3/projects/b263d884af944fdc867ae745f2d6e965/users/9ebb7fa8eafc4485bd7ee670d9050a57/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:00.526218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.527972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:00.533584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f12698cccc44fb9a7758503d7f569d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:00.541351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f12698cccc44fb9a7758503d7f569d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:00.551549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f12698cccc44fb9a7758503d7f569d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:00.589292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0adb127b-21d9-43f1-a434-f36105aff6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f12698cccc44fb9a7758503d7f569d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:00.600467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1018/2085] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:10:59 2022] DELETE /identity/v3/users/60f12698cccc44fb9a7758503d7f569d => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:00.601981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.602245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.602524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.653428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] MFA Rules not processed for user `9ebb7fa8eafc4485bd7ee670d9050a57`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:00.654841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:00.665315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824584f-1f40-4277-b4dd-b01aad11db5a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.751498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.752154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.752440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.752743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] PATH_INFO: `/v3/users/545a4ad0f33d49e9ba9099e836f62fab` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.753945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=545a4ad0f33d49e9ba9099e836f62fab)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.756612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1019/2086] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:00.786148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.786327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.786327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:00.786327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd811e42-41b4-4bb4-9dc0-4e863beb1022 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.786606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.786606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.786606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.786606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.786924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.787738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.814146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:00.945598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1020/2087] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:00 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:00.949682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.108578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545a4ad0f33d49e9ba9099e836f62fab'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.123129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71684c-f37e-443d-ae67-c3fbe80e659e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.129861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.130559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.130843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.131120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.131769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:01.134628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed23b5d-8b99-445e-abf4-7fc1e77b4001 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:01.217983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545a4ad0f33d49e9ba9099e836f62fab'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.219086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545a4ad0f33d49e9ba9099e836f62fab'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.239900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545a4ad0f33d49e9ba9099e836f62fab'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.248869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545a4ad0f33d49e9ba9099e836f62fab'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.255651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1068/2088] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:00 2022] DELETE /identity/v3/users/545a4ad0f33d49e9ba9099e836f62fab => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:01.256811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.258249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.272206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1021/2089] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:00 2022] POST /identity/v3/users => generated 299 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:01.275798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.276752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.278255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.317121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:01.318618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.394464 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819aa86-e275-4572-b369-71d41b5d5f3c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.399357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.400082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.400490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.401048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.403679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.411268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1022/2090] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:01.412854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.416311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.431144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e2749-d8ed-4939-9315-94bfb35a2ac4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.438935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.439969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.440980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.441785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] PATH_INFO: `/v3/projects/dcaedb51ae49455dab84f4566b66d59d` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.443876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcaedb51ae49455dab84f4566b66d59d)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:01.446352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:01.505384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:01.507005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:01.517873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1069/2091] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:01.519154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.520615 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.536715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6884c-6ef1-404b-825f-ed236300705e service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.542023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.542777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.543078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.543524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.544747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:01.546870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:01.559645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1070/2092] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:01.561217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.565187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.643082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcaedb51ae49455dab84f4566b66d59d', 'request_id': 'req-97d474bd-0fda-4f98-89e4-e67d08228f68'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.669060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c48f2-4b1d-41a1-9430-66689039c3f5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.777153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcaedb51ae49455dab84f4566b66d59d', 'request_id': 'req-97d474bd-0fda-4f98-89e4-e67d08228f68'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.782333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.783227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.783586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.783939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.785157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcaedb51ae49455dab84f4566b66d59d', 'request_id': 'req-97d474bd-0fda-4f98-89e4-e67d08228f68'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.799076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:01.802083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] The token cache is being invalidate because project dcaedb51ae49455dab84f4566b66d59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:01.802575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.803386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:01.805178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1023/2093] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:01 2022] DELETE /identity/v3/projects/dcaedb51ae49455dab84f4566b66d59d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:01.809708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:01.814254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.890614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:01.892211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061053d-7835-426c-8d27-f39da8168314 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:01.909790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1071/2094] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:01.914532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dafa81-8e96-4ad9-880e-ae217a4ecbfb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.914532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dafa81-8e96-4ad9-880e-ae217a4ecbfb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.914532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dafa81-8e96-4ad9-880e-ae217a4ecbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.946301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-76dafa81-8e96-4ad9-880e-ae217a4ecbfb None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:01.950237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76dafa81-8e96-4ad9-880e-ae217a4ecbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:01.968111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d474bd-0fda-4f98-89e4-e67d08228f68 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:01.974404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1072/2095] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:01.982610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:01.983845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.985241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.985692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] PATH_INFO: `/v3/projects/6c96203022184dc89b0c485feb888801/users/653137e0e49246899c51df6f4dfdd99c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:01.987524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:01.987973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:01.988272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.014329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c96203022184dc89b0c485feb888801, user_id=653137e0e49246899c51df6f4dfdd99c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.017491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.021436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:02.022910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.032239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1073/2096] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:02.038184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.048657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47db2c-cc01-43be-a99a-7bbeed04bb18 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.054479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.055314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.055723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.056113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.056945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:02.057350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.059181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.072820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1074/2097] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:11:02.079899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.093710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8fdc7-9c66-4a20-a4ed-597d3642cd9f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.098755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.099377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.099656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.099931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.100706 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.102614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.119659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1024/2098] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:01 2022] PUT /identity/v3/projects/6c96203022184dc89b0c485feb888801/users/653137e0e49246899c51df6f4dfdd99c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:02.124504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.192210 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b97a7-ee89-4aef-8f93-9f0c1f1a3b61 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.197562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.198237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.198532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.198819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.199506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.201312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.216799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1025/2099] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:02.223858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.236364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84054a8-a1ed-4376-915a-115d62aac344 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.241784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.242861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.243683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.244083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] PATH_INFO: `/v3/projects/6c96203022184dc89b0c485feb888801/users/653137e0e49246899c51df6f4dfdd99c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.248825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c96203022184dc89b0c485feb888801, user_id=653137e0e49246899c51df6f4dfdd99c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.251636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a72e6-778b-464f-a03b-e9ff9d1eb071 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.262761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1026/2100] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:02 2022] PUT /identity/v3/projects/6c96203022184dc89b0c485feb888801/users/653137e0e49246899c51df6f4dfdd99c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:02.274853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.275810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.276103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.309786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] MFA Rules not processed for user `653137e0e49246899c51df6f4dfdd99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:02.312273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.328584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1075/2101] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:02 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:02.328584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.331795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.419316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:02.425062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1027/2102] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:02.425873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.436751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad516fec-6658-47b6-a889-87ef87964336 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.436751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.436751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.436751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.437109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] PATH_INFO: `/v3/users/de5e483e3a234f539f4f00170a282885` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.437945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5e483e3a234f539f4f00170a282885)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.440097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.501269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac503c4d-3ea1-41ac-b230-041b7c18bdaf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.506259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.507055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.507344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.507621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.508260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.510253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.672730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1028/2103] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:02 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:02.673731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.675551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.738947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d3a6-b04d-47b7-a56c-a822de6d8d87 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.742819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.743473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.743755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.744026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.746015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.764798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5e483e3a234f539f4f00170a282885'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:02.818641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.820098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.830919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1029/2104] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:02.831712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.833273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:02.849162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5e298-f4fc-4325-90c9-098a7bf1a43c service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:02.855637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:02.859231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:02.859231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:02.859231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] PATH_INFO: `/v3/projects/e4b2d4375dd84e3081ccbdd638265211` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:02.859231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b2d4375dd84e3081ccbdd638265211)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:02.861431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:02.888084 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5e483e3a234f539f4f00170a282885'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:02.889234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5e483e3a234f539f4f00170a282885'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:02.903270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5e483e3a234f539f4f00170a282885'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:02.911083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5e483e3a234f539f4f00170a282885'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:02.918467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1076/2105] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:02 2022] DELETE /identity/v3/users/de5e483e3a234f539f4f00170a282885 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:02.919462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:02.921605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:03.005091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf097b5-aea8-4923-87c7-e0498ed9aa57 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.013449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.014438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.014724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.015057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.017233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.021953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.038449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1077/2106] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:03.039898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:03.068723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba095f-7e62-4e9f-a618-3532d2d08bb9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.090456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b2d4375dd84e3081ccbdd638265211', 'request_id': 'req-041f8ab8-29ca-4b12-93a4-e2ad545d8437'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.185472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.186299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.186571 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.187097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.187739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.193710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.212992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1078/2107] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:03.213958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:03.224823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99bb74-0944-44a1-974f-04a252470043 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.229694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.230377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.230720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.231034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] PATH_INFO: `/v3/projects/7bf5ea161a904d46a80b3ab0132cb01c/users/854dda46baec4cd69da65f39f4bb691b/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.247435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf5ea161a904d46a80b3ab0132cb01c, user_id=854dda46baec4cd69da65f39f4bb691b, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.250857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f819b7-a2b1-4778-a796-bc9f8f97e65b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.259061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b2d4375dd84e3081ccbdd638265211', 'request_id': 'req-041f8ab8-29ca-4b12-93a4-e2ad545d8437'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.266825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b2d4375dd84e3081ccbdd638265211', 'request_id': 'req-041f8ab8-29ca-4b12-93a4-e2ad545d8437'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.278727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] The token cache is being invalidate because project e4b2d4375dd84e3081ccbdd638265211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:03.279946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.280897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.282496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1030/2108] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:02 2022] DELETE /identity/v3/projects/e4b2d4375dd84e3081ccbdd638265211 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:03.286488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:03.287884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:03.307926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8ab8-29ca-4b12-93a4-e2ad545d8437 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.322612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.323471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.323928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.324167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] PATH_INFO: `/v3/users/f5a070cbcb2f4ca990533056ddd84752` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.326195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a070cbcb2f4ca990533056ddd84752)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.332146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.380884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1079/2109] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:03 2022] PUT /identity/v3/projects/7bf5ea161a904d46a80b3ab0132cb01c/users/854dda46baec4cd69da65f39f4bb691b/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:03.392983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.393309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.393594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.438178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] MFA Rules not processed for user `854dda46baec4cd69da65f39f4bb691b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:03.439494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:03.519223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1080/2110] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:03.519861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:03.521173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:03.582691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a070cbcb2f4ca990533056ddd84752'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.588095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41a0-ea29-41e2-b88a-060b9ea8137e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.593019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.593663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.594075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.594365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] PATH_INFO: `/v3/projects/61d5b317b3684ff0a9a125147777d310` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.595657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d5b317b3684ff0a9a125147777d310)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.597714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.601629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:03.673114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a070cbcb2f4ca990533056ddd84752'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.673760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a070cbcb2f4ca990533056ddd84752'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.681845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a070cbcb2f4ca990533056ddd84752'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.702718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a070cbcb2f4ca990533056ddd84752'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.710815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1031/2111] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:03 2022] DELETE /identity/v3/users/f5a070cbcb2f4ca990533056ddd84752 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:03.711704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:03.713090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:03.750031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d5b317b3684ff0a9a125147777d310', 'request_id': 'req-64cd958e-9f0e-4610-b503-7471d32e67f0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.808626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab4aa-aa3c-4856-b0ed-936b53be45b7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:03.814176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:03.815540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.815822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.816094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:03.816771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:03.818970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:03.962461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d5b317b3684ff0a9a125147777d310', 'request_id': 'req-64cd958e-9f0e-4610-b503-7471d32e67f0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.970940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d5b317b3684ff0a9a125147777d310', 'request_id': 'req-64cd958e-9f0e-4610-b503-7471d32e67f0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.984462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] The token cache is being invalidate because project 61d5b317b3684ff0a9a125147777d310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:03.984794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.985466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64cd958e-9f0e-4610-b503-7471d32e67f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:03.986956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1081/2112] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:03 2022] DELETE /identity/v3/projects/61d5b317b3684ff0a9a125147777d310 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:03.992067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8585-9c71-4a21-a639-270594e58a3f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:03.992361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8585-9c71-4a21-a639-270594e58a3f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:03.992698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b8585-9c71-4a21-a639-270594e58a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.013442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ed1b8585-9c71-4a21-a639-270594e58a3f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:04.015211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ed1b8585-9c71-4a21-a639-270594e58a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.020906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1032/2113] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:03 2022] POST /identity/v3/projects => generated 379 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:04.024676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1082/2114] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:04.039871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.039871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.041576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.041867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.042146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.068407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:04.072003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.156357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba8c4-91dc-4e7d-8b77-00cc2f673366 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.157122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1083/2115] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:04.162534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.167322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.170603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.170603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.170603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.170603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.174767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.182201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c06b-1e6c-4600-b128-1c868fa48621 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.189176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.191777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.191777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.191777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.192746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:04.193506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.196804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.212050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1084/2116] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:04.216535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.230488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fbf74-4114-4602-a95b-f26db079435d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.236267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.236954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.237258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.237573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.238291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.240336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.330862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:04.373019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1085/2118] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:04.376915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.378927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1033/2118] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/users => generated 296 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:04.379763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.391169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c66a93-5054-44ee-becf-938b34fc2794 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.467754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6516a-9e4f-4f24-b5bf-ccae1ff3c4ee admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.470942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.471575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.471859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.472138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.472817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.474812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.478321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.478321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.478321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.478688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.479823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.483342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.495280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1086/2119] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:04.499869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.499869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.512307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7775d6-634a-46bd-a5e0-d1388462102f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.517826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.518689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.519012 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.519292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] PATH_INFO: `/v3/projects/08bd615f8a964206869b92f5f8623a58` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.520433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bd615f8a964206869b92f5f8623a58)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.522376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.640997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1034/2120] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:04.640997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.649535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28eb9-5094-44d8-b4eb-7cd19280d326 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.654785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.655493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.655774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.656108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] PATH_INFO: `/v3/projects/341e5ca2085746a3b429f890f32f9efc/users/b93a85faa56042349a48f7311447a3d9/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.674907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341e5ca2085746a3b429f890f32f9efc, user_id=b93a85faa56042349a48f7311447a3d9, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.677805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.692433 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bd615f8a964206869b92f5f8623a58', 'request_id': 'req-b129baa9-23c8-4eca-a53d-1458d6b777b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:04.785530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bd615f8a964206869b92f5f8623a58', 'request_id': 'req-b129baa9-23c8-4eca-a53d-1458d6b777b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:04.792487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1035/2121] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:04 2022] PUT /identity/v3/projects/341e5ca2085746a3b429f890f32f9efc/users/b93a85faa56042349a48f7311447a3d9/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:04.793824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.793934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bd615f8a964206869b92f5f8623a58', 'request_id': 'req-b129baa9-23c8-4eca-a53d-1458d6b777b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:04.808494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] The token cache is being invalidate because project 08bd615f8a964206869b92f5f8623a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:04.808818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:04.809489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:04.811260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1087/2122] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:04 2022] DELETE /identity/v3/projects/08bd615f8a964206869b92f5f8623a58 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:04.812121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.813515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.862348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f72d76-d45c-4c02-8440-66ffed8f59e4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.867684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.868776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.869128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.869530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.870249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.872007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedc2f-55b4-47f1-ad96-a6b668c482fa admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.882862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1036/2123] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:04.884103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.884400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.884703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.900377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129baa9-23c8-4eca-a53d-1458d6b777b1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.905104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:04.906321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.906441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.907082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.907364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.907637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.908540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.910318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c7f7-871b-4d12-a12f-ebe04e4bee5f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.914563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1037/2124] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:04.915454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.916754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.925196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1088/2125] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:04.925196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.925196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.925196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.934588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4e0b9-46e6-4a4a-a405-53350570eb7b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.940029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.940681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.940966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.941241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.941895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.943771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.949060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:04.950515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.955426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1038/2126] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:04.956025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.960200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1089/2127] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:04.961112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.970002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b2c-11f7-4bfc-8ffa-34ea29560e5b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.971776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642910a-f661-4075-999e-6ea6c89b5f50 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.975218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.975940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.976229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.976542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] PATH_INFO: `/v3/projects/341e5ca2085746a3b429f890f32f9efc/users/b93a85faa56042349a48f7311447a3d9/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.977004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.977672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.978092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.978369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] PATH_INFO: `/v3/projects/b8eeda03b1ab4c3e8fa035b3566d7e49/users/f1421549f2c34db8a75176ecef573353/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.978513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341e5ca2085746a3b429f890f32f9efc, user_id=b93a85faa56042349a48f7311447a3d9, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.981287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.993224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1039/2128] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:04 2022] PUT /identity/v3/projects/341e5ca2085746a3b429f890f32f9efc/users/b93a85faa56042349a48f7311447a3d9/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:04.994068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.995197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eeda03b1ab4c3e8fa035b3566d7e49, user_id=f1421549f2c34db8a75176ecef573353, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.998032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.061754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290feb-e86f-4213-b3e1-7bdc6da267e2 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.067046 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.067926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.068201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.068477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.069168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:05.069471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.071075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f9bd-9382-4db7-bf57-291a5a326117 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.086840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1040/2129] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:05.086840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333a30-71fb-480c-951a-302f4f0914c4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.086840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333a30-71fb-480c-951a-302f4f0914c4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.086840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333a30-71fb-480c-951a-302f4f0914c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.108319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1090/2130] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:04 2022] PUT /identity/v3/projects/b8eeda03b1ab4c3e8fa035b3566d7e49/users/f1421549f2c34db8a75176ecef573353/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:05.109445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.114597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-12333a30-71fb-480c-951a-302f4f0914c4 None None] MFA Rules not processed for user `b93a85faa56042349a48f7311447a3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:05.115843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-12333a30-71fb-480c-951a-302f4f0914c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.185286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d58f-566a-4ca7-9b34-2e2543210849 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.190547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.191557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.192868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.193186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.193910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.200469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1041/2131] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:05.206750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.207080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.207080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.207080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.222466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:05.223714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.235646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1042/2132] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:05.235646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.240942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.301871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563719a8-10d6-4917-b1df-955665cda8d4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.305545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.306159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.306445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.306722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.316768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.318556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.326763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1091/2133] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:05 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:05.327363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.329165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1043/2134] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:05.329366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.332137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.343055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859497-081b-4e89-8300-e57258cbb61c service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.395900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bce853-6f30-4404-a857-824ecde281f9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.399637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.400282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.400587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.400868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.402556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.403170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.403452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.403732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.404447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.406837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.411978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.413537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.424228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1092/2135] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:05.516494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1044/2136] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:05 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:05.522905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.537826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721060-931a-472a-abd1-14d675654fcc service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.546823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.547439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.547724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.548003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.548711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.550339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.567002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1093/2137] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:05.572482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.591408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621e19-408c-463e-b7b0-5e95deea8883 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.599174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.599836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.600132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.600373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.601065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.602729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.620302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1045/2138] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:05.626527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.640108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:05.643308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67337562-6610-47a6-ba58-09f691e845c9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.648724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.649412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.649726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.650264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] PATH_INFO: `/v3/projects/4033ef4479744033a19782f9bbfa6fa1/users/588a89e6454f40758e863f5025c8afe1/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.670798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4033ef4479744033a19782f9bbfa6fa1, user_id=588a89e6454f40758e863f5025c8afe1, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.673715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d3d64-edd4-44a1-87d0-576c3e0ad03e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.722267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691473-4417-423f-852d-85c2feeeeccc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:05.726566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:05.727948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.728381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.728938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.730940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.791846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1094/2139] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:05 2022] PUT /identity/v3/projects/4033ef4479744033a19782f9bbfa6fa1/users/588a89e6454f40758e863f5025c8afe1/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:05.809854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:05.810220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:05.810655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:05.855643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] MFA Rules not processed for user `588a89e6454f40758e863f5025c8afe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:05.857087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:05.861752 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:05.864599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:05.878202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1046/2140] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:05.972662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:06.019870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1095/2141] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:06.042374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:06.045625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:06.126909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed97235-473e-4ada-9e7b-39f8b2f808e1 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:06.188542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:06.188542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:06.188542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:06.188542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:06.198496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:06.200007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:06.211427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1047/2142] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:06.565113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:06.631261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5f00-422a-4179-9272-680307e6ed7c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:06.635398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:06.636070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:06.636348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:06.636711 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:06.638782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:06.714781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:06.716298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:06.727348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1096/2143] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:06.808928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:09.076905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:09.430088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:09.442264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f2413-1699-46d6-b64b-fcb0b29499e0 service glance] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:09.448721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:09.456419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:09.457036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:09.457859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:09.460792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:09.584480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:09.586144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22275-b5bf-4365-b93c-7921a29a96f9 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:09.598716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1048/2144] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:09.799542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:10.461718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:10.463305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:10.557120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6854-37a1-4332-b099-e6daafe6b443 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:10.562820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:10.563740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:10.564208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:10.564481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] PATH_INFO: `/v3/users/3159184937c2450387039c5ede1a2a49` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:10.571600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3159184937c2450387039c5ede1a2a49)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:10.573827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:10.933765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3159184937c2450387039c5ede1a2a49'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:11.031536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3159184937c2450387039c5ede1a2a49'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:11.032916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3159184937c2450387039c5ede1a2a49'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:11.058608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3159184937c2450387039c5ede1a2a49'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:11.075792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3159184937c2450387039c5ede1a2a49'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:11.115778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:11.123545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:11.123545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:11.124271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1097/2145] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:10 2022] DELETE /identity/v3/users/3159184937c2450387039c5ede1a2a49 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:11.150367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:11.152666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:11.248212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1049/2146] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:11.259653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:11.260415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:11.350450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165aecf-3c1b-437f-b2ec-4c23158b1734 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:11.354808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:11.355506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:11.355781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:11.356058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:11.368658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:11.370507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c5787-4337-43e9-90c1-060bdab6dd2f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:11.382221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1098/2147] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:11.950302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:11.952556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:11.972262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d629-42a9-44d7-b0f1-72daa99a0d09 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:11.979181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:11.981250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:11.981708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:11.982655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] PATH_INFO: `/v3/projects/39711e2df4b146bda1f12a23e8ffd772` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:11.985072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39711e2df4b146bda1f12a23e8ffd772)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:11.988415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:12.182086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39711e2df4b146bda1f12a23e8ffd772', 'request_id': 'req-781528c7-cea0-49d2-91ca-0a6208083f49'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:12.270275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39711e2df4b146bda1f12a23e8ffd772', 'request_id': 'req-781528c7-cea0-49d2-91ca-0a6208083f49'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:12.274466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39711e2df4b146bda1f12a23e8ffd772', 'request_id': 'req-781528c7-cea0-49d2-91ca-0a6208083f49'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:12.290851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] The token cache is being invalidate because project 39711e2df4b146bda1f12a23e8ffd772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:12.291410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:12.292360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-781528c7-cea0-49d2-91ca-0a6208083f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:12.295436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1050/2148] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:11 2022] DELETE /identity/v3/projects/39711e2df4b146bda1f12a23e8ffd772 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:12.300227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:12.300797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:12.305261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:12.329974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:12.331582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:12.436733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1099/2149] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:12.439272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:12.439780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:12.440207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:12.463417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:12.466136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:12.479458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:12.480668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1051/2150] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:12.492011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efed3c3-0424-42de-9da8-b94e005a0f94 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:12.500381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:12.501678 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:12.501972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:12.502257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:12.502940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:12.503255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:12.505115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:12.521274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1100/2151] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:12.525501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:12.538700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721aeeb6-e061-47f1-afaa-cc3a1320ce0c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:12.545997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:12.546711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:12.547177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:12.547621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:12.551972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:12.551972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:12.774757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1052/2152] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:12 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:12.779190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:12.789996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f5653-e4c9-4b07-829f-c5e3616a1ed9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:12.881119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:12.882118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:12.882479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:12.882907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:12.883691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:12.886557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.081354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1101/2153] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:12 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:13.082278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.102981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7874bfc-60fc-49a1-b6a4-141ea2e39a92 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.115023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.119753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.119753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.119753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.119753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.119753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.132172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1053/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:13.137592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.151295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c550a-38f3-474f-99a7-995f94ff73aa admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.157772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.158481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.158761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.159197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.160134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.163020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c98a0c-9362-4e91-8b39-0f1a3e350de3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.196771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1102/2155] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:13.202374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.221093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7def84-1ec9-434f-9a8c-187db3ef6d70 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.231325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.236798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.236798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.236798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] PATH_INFO: `/v3/projects/36f6360d17664e0191fa60e26632a6ab/users/a142d8a5017a41dc89f403df82099f94/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.284666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f6360d17664e0191fa60e26632a6ab, user_id=a142d8a5017a41dc89f403df82099f94, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.290093 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addafef5-d32b-48bc-8fdc-8090909d40c3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.402754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:13.446402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1054/2156] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:13 2022] PUT /identity/v3/projects/36f6360d17664e0191fa60e26632a6ab/users/a142d8a5017a41dc89f403df82099f94/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:13.458838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.459541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.459541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.505892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] MFA Rules not processed for user `a142d8a5017a41dc89f403df82099f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:13.507072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.612358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.612896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.613404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.634300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1103/2157] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:13.647357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.649770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.678079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] MFA Rules not processed for user `f1421549f2c34db8a75176ecef573353`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:13.679475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.764716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53feb896-be54-484d-a7f8-aa51edcc3a44 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.771796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.772780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.773573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.773860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.788835 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.790300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.801863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1104/2158] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:13.815720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1055/2159] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:13.840955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.845784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.961746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb8b5-47ae-4df3-b79c-8ecd2262d9f7 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.969471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.970592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.970883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.971168 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.989599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.992039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956da57-94e7-430f-a0b9-f82b09544cb2 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:14.004717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1105/2160] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:14.361817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:16.574065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:16.590148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:16.592698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:16.688241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6fbb3-9fcd-42f8-a468-7530be4cb3aa None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:16.693652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:16.694328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:16.694613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:16.694887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] PATH_INFO: `/v3/users/c558eabf556241bebe3d552a680f9940` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:16.696180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c558eabf556241bebe3d552a680f9940)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:16.698177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:17.030571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c558eabf556241bebe3d552a680f9940'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.229706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c558eabf556241bebe3d552a680f9940'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.229706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c558eabf556241bebe3d552a680f9940'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.258161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c558eabf556241bebe3d552a680f9940'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.307353 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c558eabf556241bebe3d552a680f9940'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.325027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1056/2161] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:16 2022] DELETE /identity/v3/users/c558eabf556241bebe3d552a680f9940 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:17.329854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:17.337959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:17.337959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:17.398353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:17.399976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:17.565261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1106/2162] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:17.578129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:17.579769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:17.637248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:17.643205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:17.659720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8bacb-e358-4011-a206-0b7abaa0f91c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:17.666493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:17.667319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:17.667504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:17.667781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] PATH_INFO: `/v3/users/854dda46baec4cd69da65f39f4bb691b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:17.669269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854dda46baec4cd69da65f39f4bb691b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:17.671420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:17.721268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd99a-cdbe-44a4-9df0-7d80d9e74c11 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:17.721268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:17.721268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:17.721268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:17.722231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:17.731716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:17.733645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63743e4-1362-4be1-82fa-3a1d2ec848b3 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:17.745218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1057/2163] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:18.273972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.273972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.274272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.301351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] MFA Rules not processed for user `f1421549f2c34db8a75176ecef573353`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:18.302734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.360903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854dda46baec4cd69da65f39f4bb691b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.395985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1058/2164] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:18.400652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.408979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.434770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e29f9-5be8-4c99-85c0-6832c7942b48 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.440349 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.441218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.441514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.441796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] PATH_INFO: `/v3/projects/5f3e0209c169444db7790db8e1e958df` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.443456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3e0209c169444db7790db8e1e958df)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.445568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.579376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854dda46baec4cd69da65f39f4bb691b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.580100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854dda46baec4cd69da65f39f4bb691b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.603930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854dda46baec4cd69da65f39f4bb691b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.616021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8f8b6d64-7524-4698-8b3e-754ebf7afe83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854dda46baec4cd69da65f39f4bb691b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.628789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1107/2165] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:17 2022] DELETE /identity/v3/users/854dda46baec4cd69da65f39f4bb691b => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:18.636248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.636930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.637307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.664214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:18.665670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.667780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3e0209c169444db7790db8e1e958df', 'request_id': 'req-ec855eda-2d30-472e-987e-b8cbd1b024a7'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.739670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1108/2166] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:18.750823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.752657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.816272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3e0209c169444db7790db8e1e958df', 'request_id': 'req-ec855eda-2d30-472e-987e-b8cbd1b024a7'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.824867 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3e0209c169444db7790db8e1e958df', 'request_id': 'req-ec855eda-2d30-472e-987e-b8cbd1b024a7'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.834757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b598f-24ac-4be8-9a24-a240af47f6a1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.837778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] The token cache is being invalidate because project 5f3e0209c169444db7790db8e1e958df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:18.838077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.838814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.838991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.839531 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.839822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.840669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.843639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.843870 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1059/2167] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:18 2022] DELETE /identity/v3/projects/5f3e0209c169444db7790db8e1e958df => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:18.847990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.849627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.865283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855eda-2d30-472e-987e-b8cbd1b024a7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.870652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.871633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.872116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.872725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] PATH_INFO: `/v3/users/9ebb7fa8eafc4485bd7ee670d9050a57` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.874173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebb7fa8eafc4485bd7ee670d9050a57)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.876879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.877629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.881495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.897053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1109/2168] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:19.271897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebb7fa8eafc4485bd7ee670d9050a57'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:19.448262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebb7fa8eafc4485bd7ee670d9050a57'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:19.449391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebb7fa8eafc4485bd7ee670d9050a57'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:19.504473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebb7fa8eafc4485bd7ee670d9050a57'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:19.504473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebb7fa8eafc4485bd7ee670d9050a57'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:19.504473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1060/2169] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:18 2022] DELETE /identity/v3/users/9ebb7fa8eafc4485bd7ee670d9050a57 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:19.738440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.772761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:19.772761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4a5c-cfa3-4d2c-9054-9bd1a4283989 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.825732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.826432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.826735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.827009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] PATH_INFO: `/v3/projects/7bf5ea161a904d46a80b3ab0132cb01c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.828152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf5ea161a904d46a80b3ab0132cb01c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.830094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:20.178661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf5ea161a904d46a80b3ab0132cb01c', 'request_id': 'req-91f85ed2-949c-4f4f-ae90-259692582401'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.345658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf5ea161a904d46a80b3ab0132cb01c', 'request_id': 'req-91f85ed2-949c-4f4f-ae90-259692582401'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.353106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf5ea161a904d46a80b3ab0132cb01c', 'request_id': 'req-91f85ed2-949c-4f4f-ae90-259692582401'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.365385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] The token cache is being invalidate because project 7bf5ea161a904d46a80b3ab0132cb01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:20.365673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.366338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.367837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1110/2170] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:19 2022] DELETE /identity/v3/projects/7bf5ea161a904d46a80b3ab0132cb01c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:20.372101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:20.373966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:20.386966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e99e2-e8fc-464d-ba8e-2203b0d1a1f6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:20.455229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:20.455993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:20.456387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:20.456785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] PATH_INFO: `/v3/users/b93a85faa56042349a48f7311447a3d9` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:20.458089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93a85faa56042349a48f7311447a3d9)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:20.460306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:20.517916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:20.523823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:20.548678 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f85ed2-949c-4f4f-ae90-259692582401 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:20.556381 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:20.557348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:20.558326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:20.559029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] PATH_INFO: `/v3/projects/b263d884af944fdc867ae745f2d6e965` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:20.561296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b263d884af944fdc867ae745f2d6e965)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:20.563932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:20.787479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:20.800755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93a85faa56042349a48f7311447a3d9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.803245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b263d884af944fdc867ae745f2d6e965', 'request_id': 'req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.925390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93a85faa56042349a48f7311447a3d9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.926904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93a85faa56042349a48f7311447a3d9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.936821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93a85faa56042349a48f7311447a3d9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.952874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93a85faa56042349a48f7311447a3d9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:20.959100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1061/2171] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:20 2022] DELETE /identity/v3/users/b93a85faa56042349a48f7311447a3d9 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:21.020118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b263d884af944fdc867ae745f2d6e965', 'request_id': 'req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.030753 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b263d884af944fdc867ae745f2d6e965', 'request_id': 'req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.042873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] The token cache is being invalidate because project b263d884af944fdc867ae745f2d6e965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:21.043277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.044105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.045951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1111/2172] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:20 2022] DELETE /identity/v3/projects/b263d884af944fdc867ae745f2d6e965 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:21.053779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:21.053779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:21.157403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885edc88-750b-44e2-8984-406035d23ef6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:21.163805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:21.164779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:21.165236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:21.165678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] PATH_INFO: `/v3/users/653137e0e49246899c51df6f4dfdd99c` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:21.167309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653137e0e49246899c51df6f4dfdd99c)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:21.169678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:21.479201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653137e0e49246899c51df6f4dfdd99c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.579470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653137e0e49246899c51df6f4dfdd99c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.580421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653137e0e49246899c51df6f4dfdd99c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.592814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653137e0e49246899c51df6f4dfdd99c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.593232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:21.596848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:21.606880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653137e0e49246899c51df6f4dfdd99c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:21.614258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1062/2173] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:21 2022] DELETE /identity/v3/users/653137e0e49246899c51df6f4dfdd99c => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:21.723086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7e1d-65c3-47f4-9a5d-c63ad0e6922c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:21.822817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:21.823470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:21.823755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:21.824212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] PATH_INFO: `/v3/projects/341e5ca2085746a3b429f890f32f9efc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:21.825535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=341e5ca2085746a3b429f890f32f9efc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:21.827795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.115029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341e5ca2085746a3b429f890f32f9efc', 'request_id': 'req-6813128c-0d9c-4038-a757-98a5aa5d6ddb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.226446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.228308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.254118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c1c2-1de6-41e7-a0ac-e73be8612f81 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.294373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341e5ca2085746a3b429f890f32f9efc', 'request_id': 'req-6813128c-0d9c-4038-a757-98a5aa5d6ddb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.304335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341e5ca2085746a3b429f890f32f9efc', 'request_id': 'req-6813128c-0d9c-4038-a757-98a5aa5d6ddb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.317360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] The token cache is being invalidate because project 341e5ca2085746a3b429f890f32f9efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:22.317653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.318561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6813128c-0d9c-4038-a757-98a5aa5d6ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.320351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1112/2174] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:21 2022] DELETE /identity/v3/projects/341e5ca2085746a3b429f890f32f9efc => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:22.322663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.323502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.323792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.324079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] PATH_INFO: `/v3/projects/6c96203022184dc89b0c485feb888801` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.325590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c96203022184dc89b0c485feb888801)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.326478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b651-b809-4139-9304-fb4e471f6816 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.326858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b651-b809-4139-9304-fb4e471f6816 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.327244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b651-b809-4139-9304-fb4e471f6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.328321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.351506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7258b651-b809-4139-9304-fb4e471f6816 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:22.353156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7258b651-b809-4139-9304-fb4e471f6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.361598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1113/2175] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:22.369478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.369702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.369976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.391726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:22.393612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.403113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1114/2176] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:22.408643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.419265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda032db-b52c-4587-8e64-60b2f5eba008 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.425119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.425935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.426228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.426504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.427187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:22.427496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.429197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.444590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1115/2177] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:11:22.448819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.460110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168d9c6-fb0e-4f02-a1fd-696a3a9e9a54 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.464846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.465487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.465793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.466068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.467426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.469268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.506119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c96203022184dc89b0c485feb888801', 'request_id': 'req-fa4be632-4e42-493c-862d-785e845dd880'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.600842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c96203022184dc89b0c485feb888801', 'request_id': 'req-fa4be632-4e42-493c-862d-785e845dd880'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.608171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1116/2178] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:22.610058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c96203022184dc89b0c485feb888801', 'request_id': 'req-fa4be632-4e42-493c-862d-785e845dd880'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.612162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.624567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] The token cache is being invalidate because project 6c96203022184dc89b0c485feb888801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:22.625294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.626129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fa4be632-4e42-493c-862d-785e845dd880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:22.628601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1063/2179] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:22 2022] DELETE /identity/v3/projects/6c96203022184dc89b0c485feb888801 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:22.634384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ba99-8f61-4811-8ea2-bb35e3f87690 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.634794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ba99-8f61-4811-8ea2-bb35e3f87690 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.635176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ba99-8f61-4811-8ea2-bb35e3f87690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.663789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1668ba99-8f61-4811-8ea2-bb35e3f87690 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:22.665838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1668ba99-8f61-4811-8ea2-bb35e3f87690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.711657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564e065-e38d-4fad-b2d0-946e333493cc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.718395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.719612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.719612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.719868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.720773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.723315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.781903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1064/2180] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:22.790811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.791266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.791755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.824324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:22.825723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.837194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1065/2181] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:22.842123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.866693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835229bc-16a3-4be1-afd9-d136494de7e4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.866789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1117/2182] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/users => generated 282 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:22.867204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.871467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.872315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.873242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.873663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.875904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:22.876436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:22.876733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.878457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.900824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1066/2183] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:22.904346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.907068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda44e-1f3d-4751-a474-cd01dcbb116f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.919686 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.921636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.922257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.922445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.923343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.927194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096807c-bde3-4744-8cba-73c4d603671f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.928259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.944647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.945383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.945677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.946058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.946748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.955337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1118/2184] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:22.955574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:22.956638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:22.980503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8158d-2752-44b7-a7b6-4facf95a7262 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:22.988815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:22.988815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:22.988815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:22.989151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:22.989919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:22.991554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.007557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1119/2185] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:23.011761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.024192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbd7e-48e8-475a-92a9-e59fc57b7419 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.030393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.031765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.032138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.032496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] PATH_INFO: `/v3/projects/9038470ad2c747d9b56e645e29ebb942/users/7ef11c057d6f40ada4531df02dccff55/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.054942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9038470ad2c747d9b56e645e29ebb942, user_id=7ef11c057d6f40ada4531df02dccff55, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.057745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022cedc-91b2-402a-8adc-9a0e475de3f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.154982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1067/2186] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:22 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:23.159840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.246284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b8b94-ec61-4aaf-9ebc-e1279c38bb17 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.251864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1120/2187] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:23 2022] PUT /identity/v3/projects/9038470ad2c747d9b56e645e29ebb942/users/7ef11c057d6f40ada4531df02dccff55/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:23.265526 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.265918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.266315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.309826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] MFA Rules not processed for user `7ef11c057d6f40ada4531df02dccff55`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:23.313346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:23.330509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.333011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.333011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.333011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.333011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.334457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.432863 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1121/2188] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:23.435971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.457733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a133-adf5-4fd4-b1c3-2e415c0f76f6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.465749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.468149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.468708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.469222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.470424 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.474314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.478575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1068/2189] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:23 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:23.483847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.494984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388194-c0dd-4d3d-a756-1d8479e42132 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.501007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.501697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.501988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.502400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.502928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.504596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.520154 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1069/2190] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:23.524219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.536325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156387a7-1d52-4204-8b49-4012a89cc9d1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.545567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.546133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.546610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.547099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.548228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.551195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.565336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1070/2191] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:23.569937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.581268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43873-cbff-4374-87b2-e1be8e9d6c3f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.586163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.587037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.587598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.588061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] PATH_INFO: `/v3/projects/9e164d050e9e42c787b2d182edaad160/users/aa5985f473da46d698a8912e0463603c/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.612180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e164d050e9e42c787b2d182edaad160, user_id=aa5985f473da46d698a8912e0463603c, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.616594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f15a3-db59-4ca0-a04e-3972ae6b72bc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:23.679368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1122/2192] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:23 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:23.682646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:23.761481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d322-1058-4ff7-9f1f-e27e8c8c4f4f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:23.773463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1071/2193] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:23 2022] PUT /identity/v3/projects/9e164d050e9e42c787b2d182edaad160/users/aa5985f473da46d698a8912e0463603c/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:23.799633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.799995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.800387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.874508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] MFA Rules not processed for user `aa5985f473da46d698a8912e0463603c`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:23.877346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:23.890732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:23.892148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:23.892703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:23.893397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:23.894798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:23.900250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.044877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1072/2194] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:24.061120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:24.064307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:24.103353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1123/2195] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:23 2022] POST /identity/v3/users => generated 289 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:24.110355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:24.180492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c0b65-0616-4033-90d1-075eb6fd30c3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:24.199140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:24.200468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.201707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.203048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.205359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:24.209224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.252861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1124/2196] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:24.254364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:24.270796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaba72-1036-43f8-b633-edbd7fa965b7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:24.279358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:24.280275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.280919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.281302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.284071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202da8-861f-4611-8247-6b52db813a86 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:24.293989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:24.294386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:24.295937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.296428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.297086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.297295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] PATH_INFO: `/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca/users/f755105e3e244b178d40c8ba21349daa/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.314050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1073/2197] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:11:24.328659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531e36e7ee8b4f8788f7bfb75e8da3ca, user_id=f755105e3e244b178d40c8ba21349daa, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:24.336190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.589902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1125/2198] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:24 2022] PUT /identity/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca/users/f755105e3e244b178d40c8ba21349daa/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:24.595663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:24.613206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2925d9-589d-47bb-bd9c-ce81145c5109 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:24.728494 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:24.730141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.734665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.734665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.734665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:24.735326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b94561-c17f-4bb8-9835-abd91c8129d4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.754622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1074/2199] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:24.759594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:24.774880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de4832-0f98-4009-a68a-f8ff2c19fac9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:24.783499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:24.784646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.785142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.785643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] PATH_INFO: `/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca/users/f755105e3e244b178d40c8ba21349daa/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.788979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=531e36e7ee8b4f8788f7bfb75e8da3ca, user_id=f755105e3e244b178d40c8ba21349daa, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:24.794589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:24.814311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1126/2200] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:24 2022] PUT /identity/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca/users/f755105e3e244b178d40c8ba21349daa/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:24.827958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:24.828370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:24.828779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:24.864873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] MFA Rules not processed for user `f755105e3e244b178d40c8ba21349daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:24.866577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:24.983800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1075/2201] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:24.998497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:25.377861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:25.380061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:25.456939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3b4a-8b89-4b75-8ec9-94ee54fcaffd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:25.462284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:25.462957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:25.463232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:25.463546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:25.474426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:25.475904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:25.488203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1127/2202] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:11:26.018194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:26.033261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae94e2-f33c-4f27-a6ae-3093bfce8f35 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:26.039077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:26.039855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:26.040700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:26.041039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:26.163317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:26.164834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:26.180865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1076/2203] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:28.547700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:30.542591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:32.243028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:36.308431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:36.546402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:40.017552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:40.383963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:44.347762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:44.724730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:44.940798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.154694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd87b3-c67b-4470-aead-947022698c41 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.163512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.165088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.165632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.166091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] PATH_INFO: `/v3/users/7ef11c057d6f40ada4531df02dccff55` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.169819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef11c057d6f40ada4531df02dccff55)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.174093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.487860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef11c057d6f40ada4531df02dccff55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.536044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.539611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:45.613907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd49308-c207-43f4-92e4-104624b29a67 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.624638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef11c057d6f40ada4531df02dccff55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.630783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef11c057d6f40ada4531df02dccff55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.645678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.648951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.650347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.651857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] PATH_INFO: `/v3/users/2f64414eee0b481685aee1ab4cf4b6d2` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.660989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f64414eee0b481685aee1ab4cf4b6d2)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.671625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.685909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef11c057d6f40ada4531df02dccff55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.722543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-479984a2-d776-441c-9a15-d4df5efc7137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef11c057d6f40ada4531df02dccff55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.749525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1128/2204] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:44 2022] DELETE /identity/v3/users/7ef11c057d6f40ada4531df02dccff55 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:45.752533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.753221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.764681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.805772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:45.807358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:45.899903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1129/2205] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:45.911364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.912994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:46.005754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ebdd4-8867-42c5-8e57-ea533462e5d9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.010089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.010960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.011449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.011953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.024091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.026534 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.039230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1130/2206] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:11:46.089704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f64414eee0b481685aee1ab4cf4b6d2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:46.250681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f64414eee0b481685aee1ab4cf4b6d2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:46.251460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f64414eee0b481685aee1ab4cf4b6d2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:46.265276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f64414eee0b481685aee1ab4cf4b6d2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:46.291718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f64414eee0b481685aee1ab4cf4b6d2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:46.303952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1077/2207] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:45 2022] DELETE /identity/v3/users/2f64414eee0b481685aee1ab4cf4b6d2 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:46.572882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:46.644901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.647473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:46.677283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2f24-fbb0-4252-85dc-68dbe41d0f21 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.747180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.751940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:46.782672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.785672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.785672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.785672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] PATH_INFO: `/v3/projects/9038470ad2c747d9b56e645e29ebb942` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.787651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9038470ad2c747d9b56e645e29ebb942)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.792294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.881304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:46.886892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318d0f-107d-4105-8db9-cf164752e533 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.902006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.904069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.904994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.905976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] PATH_INFO: `/v3/projects/68092d3a0c31414db9be1fae39d2cbec` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.908690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68092d3a0c31414db9be1fae39d2cbec)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.912716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:47.105415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9038470ad2c747d9b56e645e29ebb942', 'request_id': 'req-d97a7da3-5e00-4c2f-833a-459579423d27'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.149330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68092d3a0c31414db9be1fae39d2cbec', 'request_id': 'req-8325ae9c-ab2d-46f7-af1a-9b28616783b0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.246973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9038470ad2c747d9b56e645e29ebb942', 'request_id': 'req-d97a7da3-5e00-4c2f-833a-459579423d27'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.263272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9038470ad2c747d9b56e645e29ebb942', 'request_id': 'req-d97a7da3-5e00-4c2f-833a-459579423d27'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.286006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] The token cache is being invalidate because project 9038470ad2c747d9b56e645e29ebb942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:47.295812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.295812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.295812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1131/2208] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:46 2022] DELETE /identity/v3/projects/9038470ad2c747d9b56e645e29ebb942 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:47.295812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:47.295812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:47.330077 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68092d3a0c31414db9be1fae39d2cbec', 'request_id': 'req-8325ae9c-ab2d-46f7-af1a-9b28616783b0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.338825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68092d3a0c31414db9be1fae39d2cbec', 'request_id': 'req-8325ae9c-ab2d-46f7-af1a-9b28616783b0'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.356674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] The token cache is being invalidate because project 68092d3a0c31414db9be1fae39d2cbec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:47.357630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.360425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:47.362608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1078/2209] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:46 2022] DELETE /identity/v3/projects/68092d3a0c31414db9be1fae39d2cbec => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:47.366547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:47.368135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:47.406340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a7da3-5e00-4c2f-833a-459579423d27 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:47.466726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325ae9c-ab2d-46f7-af1a-9b28616783b0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:47.473344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:47.474021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:47.475222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:47.475222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] PATH_INFO: `/v3/users/f755105e3e244b178d40c8ba21349daa` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:47.478140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f755105e3e244b178d40c8ba21349daa)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:47.478330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:47.536151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:47.536892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:47.537176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:47.537546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] PATH_INFO: `/v3/users/a142d8a5017a41dc89f403df82099f94` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:47.539093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a142d8a5017a41dc89f403df82099f94)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:47.556683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:47.873147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f755105e3e244b178d40c8ba21349daa'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.003383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f755105e3e244b178d40c8ba21349daa'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.004450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f755105e3e244b178d40c8ba21349daa'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.024980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f755105e3e244b178d40c8ba21349daa'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.041813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a142d8a5017a41dc89f403df82099f94'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.069363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f755105e3e244b178d40c8ba21349daa'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.088649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1079/2210] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:47 2022] DELETE /identity/v3/users/f755105e3e244b178d40c8ba21349daa => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:48.090662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:48.095002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:48.141783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a142d8a5017a41dc89f403df82099f94'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.143694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a142d8a5017a41dc89f403df82099f94'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.167798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a142d8a5017a41dc89f403df82099f94'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.181899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3f7585af-8c2c-43e5-9291-438f146a86e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a142d8a5017a41dc89f403df82099f94'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.207665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1132/2211] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:47 2022] DELETE /identity/v3/users/a142d8a5017a41dc89f403df82099f94 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:48.210442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b73d6-69e8-4443-8600-929542345604 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:48.211401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b73d6-69e8-4443-8600-929542345604 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:48.212037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b73d6-69e8-4443-8600-929542345604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:48.250612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f50b73d6-69e8-4443-8600-929542345604 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:48.252927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f50b73d6-69e8-4443-8600-929542345604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:48.326602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3bcb5-97a7-433f-bc7f-dbd9935f4015 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:48.407029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1133/2212] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:48.427917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b73d6-69e8-4443-8600-929542345604 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:48.430762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f50b73d6-69e8-4443-8600-929542345604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:48.489545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:48.490817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:48.491357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:48.491883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] PATH_INFO: `/v3/users/f2a64e1e2ffc4ec6ab00a1da88b132e5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:48.494207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a64e1e2ffc4ec6ab00a1da88b132e5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:48.498478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:48.584540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b73d6-69e8-4443-8600-929542345604 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:48.592060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:48.593458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:48.593968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:48.594469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:48.612200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:48.615070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:48.647478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1134/2213] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:11:48.656169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:48.813675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a64e1e2ffc4ec6ab00a1da88b132e5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.915136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a64e1e2ffc4ec6ab00a1da88b132e5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.917425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a64e1e2ffc4ec6ab00a1da88b132e5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.943875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a64e1e2ffc4ec6ab00a1da88b132e5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.971538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a64e1e2ffc4ec6ab00a1da88b132e5'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:48.986179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1080/2214] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:48 2022] DELETE /identity/v3/users/f2a64e1e2ffc4ec6ab00a1da88b132e5 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:49.317760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:49.320320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:49.335959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1309-59e1-4af8-969b-0b476460bf3a service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:49.364299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:49.367377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:49.436568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:49.436568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:49.436568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:49.436568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] PATH_INFO: `/v3/users/588a89e6454f40758e863f5025c8afe1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:49.438139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588a89e6454f40758e863f5025c8afe1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:49.443650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:49.514371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfb602-1489-41f8-bd0e-22e600e737ab admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:49.522553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:49.523660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:49.524004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:49.524354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] PATH_INFO: `/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:49.526217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531e36e7ee8b4f8788f7bfb75e8da3ca)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:49.529050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:49.768393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531e36e7ee8b4f8788f7bfb75e8da3ca', 'request_id': 'req-c5b04eef-3e3b-48c4-8d70-1425018d8d73'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.769183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588a89e6454f40758e863f5025c8afe1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.883278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531e36e7ee8b4f8788f7bfb75e8da3ca', 'request_id': 'req-c5b04eef-3e3b-48c4-8d70-1425018d8d73'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.898623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531e36e7ee8b4f8788f7bfb75e8da3ca', 'request_id': 'req-c5b04eef-3e3b-48c4-8d70-1425018d8d73'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.929455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] The token cache is being invalidate because project 531e36e7ee8b4f8788f7bfb75e8da3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:49.930772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.931607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:49.936205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1081/2215] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:49 2022] DELETE /identity/v3/projects/531e36e7ee8b4f8788f7bfb75e8da3ca => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:49.936205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:49.947197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.066067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04eef-3e3b-48c4-8d70-1425018d8d73 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:50.072036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:50.072881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.073166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.073441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] PATH_INFO: `/v3/projects/476c75d798904506bf29e52b4a4eae10` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.074753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476c75d798904506bf29e52b4a4eae10)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:50.078045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:50.097081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588a89e6454f40758e863f5025c8afe1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.098300 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588a89e6454f40758e863f5025c8afe1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.123673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588a89e6454f40758e863f5025c8afe1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.133347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-55513973-dcf6-4190-9ff6-4ae58c26f0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588a89e6454f40758e863f5025c8afe1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.142113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1135/2216] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:49 2022] DELETE /identity/v3/users/588a89e6454f40758e863f5025c8afe1 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:50.143524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.143811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.144092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.150123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:50.168764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] MFA Rules not processed for user `dcb0911fad8c4d20ab2e832afd6bc51f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:50.170119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.236826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1136/2217] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:50.237826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:50.239192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.335507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0c51e-58d9-4807-ae5b-dcc7307213c1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:50.350771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476c75d798904506bf29e52b4a4eae10', 'request_id': 'req-49c80fb9-b35c-4e09-a907-456722047295'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.413291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:50.413909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.414449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.414700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] PATH_INFO: `/v3/projects/36f6360d17664e0191fa60e26632a6ab` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.416022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f6360d17664e0191fa60e26632a6ab)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:50.418122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:50.445840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476c75d798904506bf29e52b4a4eae10', 'request_id': 'req-49c80fb9-b35c-4e09-a907-456722047295'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.463984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476c75d798904506bf29e52b4a4eae10', 'request_id': 'req-49c80fb9-b35c-4e09-a907-456722047295'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.486221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] The token cache is being invalidate because project 476c75d798904506bf29e52b4a4eae10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:50.486529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.487221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-49c80fb9-b35c-4e09-a907-456722047295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.489616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1082/2218] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:49 2022] DELETE /identity/v3/projects/476c75d798904506bf29e52b4a4eae10 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:50.490864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8559a-668b-49d0-9c86-6fd5cc595a2b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.491158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8559a-668b-49d0-9c86-6fd5cc595a2b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.491490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8559a-668b-49d0-9c86-6fd5cc595a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.517919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-89f8559a-668b-49d0-9c86-6fd5cc595a2b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:50.519590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-89f8559a-668b-49d0-9c86-6fd5cc595a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.532576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1083/2219] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:50.535329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dacbdd-6615-4472-a1ae-8b07d12dc9e8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.535832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dacbdd-6615-4472-a1ae-8b07d12dc9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.536320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dacbdd-6615-4472-a1ae-8b07d12dc9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.566906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d3dacbdd-6615-4472-a1ae-8b07d12dc9e8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:50.568985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d3dacbdd-6615-4472-a1ae-8b07d12dc9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.588730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1084/2220] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:50.597795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05f95-62da-4532-b5e1-7d061a21263a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.598382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05f95-62da-4532-b5e1-7d061a21263a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.598882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05f95-62da-4532-b5e1-7d061a21263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.634999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fbf05f95-62da-4532-b5e1-7d061a21263a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:50.637126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fbf05f95-62da-4532-b5e1-7d061a21263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.644682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f6360d17664e0191fa60e26632a6ab', 'request_id': 'req-d21227c8-02df-4ea8-998b-b63305eafda9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:50.763913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1085/2221] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:50.765681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.766050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.766456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.792317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:50.793615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.803287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1086/2222] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:50.804184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:50.811497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:50.897482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53325f-61fe-41f0-8570-b2f07436e883 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:50.905493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:50.906470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:50.906946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:50.907419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:50.919873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:50.921454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facf7ae-a27c-4771-a8bc-e2ddb11da777 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1087/2223] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:51.042985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:51.049945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1088/2224] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:51.049945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:51.049945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc58b4-04a9-48e6-b923-1d13d13cb527 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:51.049945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:51.050656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.087338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1089/2225] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:51.087338 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:51.115073 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9b33-6fe7-4646-90a1-7c4a8ca4a2ad admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:51.133621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:51.134760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.135270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.135985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.137263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:51.139969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:51.145266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.186898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1090/2226] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:51.189874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:51.544725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67577eff-1286-41c2-ac4e-b88d0041f82c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:51.544725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:51.544725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.544725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.546635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.546635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:51.546635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.576401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f6360d17664e0191fa60e26632a6ab', 'request_id': 'req-d21227c8-02df-4ea8-998b-b63305eafda9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:51.585071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f6360d17664e0191fa60e26632a6ab', 'request_id': 'req-d21227c8-02df-4ea8-998b-b63305eafda9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:51.600876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] The token cache is being invalidate because project 36f6360d17664e0191fa60e26632a6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:51.601337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:51.602167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:51.604287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1137/2227] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:50 2022] DELETE /identity/v3/projects/36f6360d17664e0191fa60e26632a6ab => generated 0 bytes in 1367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:51.605376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:51.607515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:51.625024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21227c8-02df-4ea8-998b-b63305eafda9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:51.630393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:51.631161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.631539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.631907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.632914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:51.635218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8d6f-aff7-4e7c-a543-b29b7cc0a7de admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.920372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:51.986002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1138/2228] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:51 2022] POST /identity/v3/projects => generated 359 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:51.995684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.996279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.996870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.007565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1091/2229] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:51 2022] POST /identity/v3/projects => generated 363 bytes in 820 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:52.012260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.037396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:52.039866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:52.194966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1266cf-6732-4e5d-a316-9a1ba59bb5c4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.213342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.216964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.216964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.216964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.216964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.218208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.222243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1139/2230] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:52.223594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.225226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:52.271332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939efe2-864c-4c1b-9ff4-da8a6a381a5d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.293642 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.296278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.296667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.296973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.297716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.300810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9b5ef-3f4f-4c2b-9362-db9f09a87bd2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.434456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1140/2231] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:52 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:52.438085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.439171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.439689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.445248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1092/2232] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:52 2022] POST /identity/v3/users => generated 280 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:52.448787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.470422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb713b1e-b3ea-41c2-a3d9-c70ea63c61b9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.477696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:52.478971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:52.482675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.483794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.484690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.485469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.487202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.494490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.494598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1141/2233] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:52.494598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.509043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2ecb-316b-4f54-8cb2-4461e1492608 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.513966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1093/2234] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:52.515274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.517769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.519259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.520106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.524780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.525591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.529185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.533663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99926-273b-4170-ae8a-c1a9b8051b4c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.547565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.547736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1142/2235] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:52.547834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.547926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.548019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.548019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.548019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:52.548019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.550555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.560647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcff4d-5e6b-475c-a983-b2c7743326b3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.567733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.569174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.569720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.570211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.571106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.573110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.580194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1094/2236] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:52.580194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.597958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df21a97-3f1d-4d2e-a022-7d6dfcf184a6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.605692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.605692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.607026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1143/2237] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:52.611057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.613839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.614516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.615799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.617913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.630079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e40211-6ce6-4969-b163-40dc46aa152e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.635670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1095/2238] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:52.636837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.639949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:52.643774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.648866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.648866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.648866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.648866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.649935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.656156 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2432ea8-90f6-4817-aa18-0890d854d989 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.662166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.663057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.663245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.663393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] PATH_INFO: `/v3/projects/4033ef4479744033a19782f9bbfa6fa1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.664733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4033ef4479744033a19782f9bbfa6fa1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:52.666834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:52.804461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1144/2239] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:52 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:52.804461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:52.890238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0fa4-2865-43c6-9abe-69922d0ca44c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:52.891740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4033ef4479744033a19782f9bbfa6fa1', 'request_id': 'req-0d64a516-fbb1-44b4-bae0-3343097d4a89'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:52.972908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:52.974077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:52.974565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:52.975065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] PATH_INFO: `/v3/projects/e44e8a23d4a641339ec3ab8bf3718b51/users/767b821543304ef6807895251bfb0589/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:52.996651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44e8a23d4a641339ec3ab8bf3718b51, user_id=767b821543304ef6807895251bfb0589, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:53.005308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:53.035350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4033ef4479744033a19782f9bbfa6fa1', 'request_id': 'req-0d64a516-fbb1-44b4-bae0-3343097d4a89'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:53.050117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4033ef4479744033a19782f9bbfa6fa1', 'request_id': 'req-0d64a516-fbb1-44b4-bae0-3343097d4a89'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:53.069627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] The token cache is being invalidate because project 4033ef4479744033a19782f9bbfa6fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:53.070211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:53.071707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:53.073849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1096/2240] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:52 2022] DELETE /identity/v3/projects/4033ef4479744033a19782f9bbfa6fa1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:53.078185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:53.079883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:53.116844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a516-fbb1-44b4-bae0-3343097d4a89 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:53.126385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:53.130810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:53.130810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:53.130810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] PATH_INFO: `/v3/projects/f113b8134b0e47ac8fab9d2e6412bf6d/users/4cae649507f840caa116b089ffab0c2f/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:53.151190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f113b8134b0e47ac8fab9d2e6412bf6d, user_id=4cae649507f840caa116b089ffab0c2f, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:53.154837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef217-6989-4907-9606-34cd63ff5a0b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:53.180830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1145/2241] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:52 2022] PUT /identity/v3/projects/e44e8a23d4a641339ec3ab8bf3718b51/users/767b821543304ef6807895251bfb0589/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:53.192107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:53.199717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:53.340604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370f789-83d7-4d55-a714-1ca8ba5c5d8b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:53.351822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:53.353209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:53.353877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:53.354838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:53.356948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:53.367585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:53.966655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1146/2242] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:53 2022] POST /identity/v3/users => generated 292 bytes in 785 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:53.970862 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1097/2243] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:53 2022] PUT /identity/v3/projects/f113b8134b0e47ac8fab9d2e6412bf6d/users/4cae649507f840caa116b089ffab0c2f/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:53.975396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:53.994070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:53.995617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664c6cc-0b67-49b2-b497-384b79ad5239 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:53.996934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:53.998703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.039327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] MFA Rules not processed for user `767b821543304ef6807895251bfb0589`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:54.041087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:54.093208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.093843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.094137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.094404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.095100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.097085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99953452-2162-4d9c-a2a3-090d6ebfde59 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.118563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1147/2244] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:54.118563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.118563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.118563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.152921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1098/2245] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:54.154916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.162144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] MFA Rules not processed for user `4cae649507f840caa116b089ffab0c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:54.164369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:54.176294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e918344-3144-4b4a-bc1e-c307d0c2632f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.185859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.186950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.187440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.187929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.188992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.190729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.213641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1099/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:54.216500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.220182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:54.244920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11288480-5170-4fdf-b785-635989d56bf6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.254035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.255101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.255571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.256066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.257283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.261152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.268916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1148/2247] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:54.269821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.306769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45ea39-4ab9-42d2-b27c-65688e9b27e8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.315573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.318853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.318853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.318853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] PATH_INFO: `/v3/projects/38807187bdf34cdd80aae712037fdff4/users/4a8be11c4c6d42009a7320dc4640e727/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.348224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38807187bdf34cdd80aae712037fdff4, user_id=4a8be11c4c6d42009a7320dc4640e727, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.353769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.398959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:54.407140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1100/2248] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:54 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:54.410444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.410444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:54.509998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1149/2249] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:54 2022] PUT /identity/v3/projects/38807187bdf34cdd80aae712037fdff4/users/4a8be11c4c6d42009a7320dc4640e727/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:54.511302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.568757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f858dcf-481f-4849-98ce-9397ec86e1df admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.712000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9f8b-0905-4bee-9990-3c7a52958558 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.723179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.724123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.724665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.725096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.729808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.730028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.730202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.730364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.730805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.731255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.815772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.817345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e7a0-aa8d-48f4-aac3-69eb699423ff service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.845316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1101/2250] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:54.847909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.848572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.849268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.854278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1150/2251] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:54 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:54.868254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.889261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29716154-753b-4966-8ba6-26ac3ac29e2c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.893447 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] MFA Rules not processed for user `4a8be11c4c6d42009a7320dc4640e727`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:54.894755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:54.897684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.898658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.899169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.899841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.901098 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.905063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:54.932969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1151/2252] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:54.932969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:54.946819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff117-d04c-4db1-8e3f-ccd618ba1cde admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:54.955187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:54.956036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:54.956450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:54.956985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] PATH_INFO: `/v3/users/4cae649507f840caa116b089ffab0c2f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:54.969824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cae649507f840caa116b089ffab0c2f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:54.970793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.017777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1102/2253] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:55.019837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.034369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1515-6f16-43f9-be85-40e8af41ba89 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.041469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:55.044091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.045020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.045428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.045849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] PATH_INFO: `/v3/projects/7a8b249f9d214b12b04cd06f377cbb99/users/3170ce48ec784eb3bce4f5a483f929a3/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.064312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8b249f9d214b12b04cd06f377cbb99, user_id=3170ce48ec784eb3bce4f5a483f929a3, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.067213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.173147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1103/2254] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:55 2022] PUT /identity/v3/projects/7a8b249f9d214b12b04cd06f377cbb99/users/3170ce48ec784eb3bce4f5a483f929a3/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:55.174045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.267897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cda192-356c-48dc-8571-f956c15923cb admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.277856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.279196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.279767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.280337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.281323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.285256 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4be37-4341-402b-a5f9-83543111a514 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.293726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cae649507f840caa116b089ffab0c2f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:55.465870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cae649507f840caa116b089ffab0c2f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:55.466611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cae649507f840caa116b089ffab0c2f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:55.486217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cae649507f840caa116b089ffab0c2f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:55.496635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cae649507f840caa116b089ffab0c2f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:55.509217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1152/2255] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:54 2022] DELETE /identity/v3/users/4cae649507f840caa116b089ffab0c2f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:55.510617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.514085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:55.532840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1104/2256] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:55 2022] POST /identity/v3/projects => generated 385 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:55.534684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.535006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.535316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.567687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:55.569849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:55.653463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5ad60-8431-454c-8788-ad8442beb80e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.716421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1105/2257] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:55.717994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.720276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:55.742580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e9d13-824a-48d8-b08b-ad25e2a41267 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.751765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.752807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.753282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.753486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.753832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.754167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.754470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.754739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.754899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.755431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.757303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.762249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.773254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1153/2258] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:55.773254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.774241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:55.901301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1106/2259] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:55 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:55.902626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:55.908137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf91b0-bb97-4f7b-aa48-2e278a18e580 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.917125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.918211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.918773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.919931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.944045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe7d11-06aa-41cf-9f45-8946370e4fe7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:55.975790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:55.978819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:55.979170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:55.979464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] PATH_INFO: `/v3/projects/7a8b249f9d214b12b04cd06f377cbb99/users/3170ce48ec784eb3bce4f5a483f929a3/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:55.985032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8b249f9d214b12b04cd06f377cbb99, user_id=3170ce48ec784eb3bce4f5a483f929a3, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.987160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:55.990030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27577cb-647d-4c73-9c28-e7a043ce9123 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:55.990197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.008662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1154/2260] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:56.010259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1107/2261] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:55 2022] PUT /identity/v3/projects/7a8b249f9d214b12b04cd06f377cbb99/users/3170ce48ec784eb3bce4f5a483f929a3/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:56.014057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.022777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.023327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.023534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.032161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb94739-6478-4515-9643-104f1ae77a2d service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.063326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] MFA Rules not processed for user `3170ce48ec784eb3bce4f5a483f929a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:56.065178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:56.112055 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.112856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.113200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.113549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.115021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.117025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.131517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1155/2262] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:56.138643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.158210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52482c-d12e-4808-a5cc-3a22280a87c1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.166359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.172237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.172237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.172237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.172237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.173211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.179138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1108/2263] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:56.189386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1156/2264] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:56.194562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.209092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361f276-dde8-451d-a571-fdbb617587e8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.214719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.215512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.216680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.217297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] PATH_INFO: `/v3/projects/dcac3d15882d470cbc68caa573fb08e7/users/bdc21a5107ad4f11b7bcedca70f3dde6/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.240192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.243770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:56.246274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac3d15882d470cbc68caa573fb08e7, user_id=bdc21a5107ad4f11b7bcedca70f3dde6, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.250600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee979f7-2405-4fb1-a965-49804ba885c1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.376047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e014-a9f9-42d7-b996-fbe9e0102358 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.382021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.383050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.383492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.384632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.401129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.403868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.413284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1109/2265] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:56 2022] PUT /identity/v3/projects/dcac3d15882d470cbc68caa573fb08e7/users/bdc21a5107ad4f11b7bcedca70f3dde6/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:56.415676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1157/2266] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:56.426135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.426432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.426718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.471471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] MFA Rules not processed for user `bdc21a5107ad4f11b7bcedca70f3dde6`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:56.476033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:56.572443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1110/2267] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:56.578698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.591373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b607f1-0493-4ca6-ad13-5060d8e6decc service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.658532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.659175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.659468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.659747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.660422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.662445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.721023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.722512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:56.770692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0e6d1-6eb7-45cf-ae8c-274f0f950845 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:56.778710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:56.779651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:56.779990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:56.780306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] PATH_INFO: `/v3/projects/f113b8134b0e47ac8fab9d2e6412bf6d` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:56.781696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f113b8134b0e47ac8fab9d2e6412bf6d)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:56.783711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:56.844575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1158/2268] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:56 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:56.864572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:56.987054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371207c-652f-43d1-b80f-d9a8d373e13c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.006671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f113b8134b0e47ac8fab9d2e6412bf6d', 'request_id': 'req-fef2ad68-95e6-401d-848e-76105d942ad6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:57.109438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.110187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.110383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.110669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.111340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.117000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f113b8134b0e47ac8fab9d2e6412bf6d', 'request_id': 'req-fef2ad68-95e6-401d-848e-76105d942ad6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:57.118368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.125065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f113b8134b0e47ac8fab9d2e6412bf6d', 'request_id': 'req-fef2ad68-95e6-401d-848e-76105d942ad6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:57.147204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] The token cache is being invalidate because project f113b8134b0e47ac8fab9d2e6412bf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:57.147489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:57.148279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:57.149895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1111/2269] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:56 2022] DELETE /identity/v3/projects/f113b8134b0e47ac8fab9d2e6412bf6d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:57.150769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.153607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:57.240284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2ad68-95e6-401d-848e-76105d942ad6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.247949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.249108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.249619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.250089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.253133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:57.347307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.347307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11188e6-0121-46db-ad4f-0cd606649f50 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.357920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1112/2270] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:57.359309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439ff9d-58c2-4c57-8ad7-821ce68b27df None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.359779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439ff9d-58c2-4c57-8ad7-821ce68b27df None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.359933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439ff9d-58c2-4c57-8ad7-821ce68b27df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.389516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1159/2271] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:56 2022] POST /identity/v3/users => generated 297 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:57.390274 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4439ff9d-58c2-4c57-8ad7-821ce68b27df None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:57.391514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.391738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4439ff9d-58c2-4c57-8ad7-821ce68b27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:57.394151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:57.402559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1113/2272] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:57.409589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718368e4-fbe1-4422-8a58-4c000abe6bb1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.422380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.427536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.427536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.427536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.427536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.430953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.431381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.432968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.433285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.469494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1160/2273] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:57.475390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.477717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:57.480590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:57.492926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65da80-e667-4464-bd2f-641d9ee6c059 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.501337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.502215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.502577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.503063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] PATH_INFO: `/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0/users/f405dc73d17e4247917fadcab884bc52/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.504689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1114/2274] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:57.507100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.523229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f3cd-a8a3-46a3-8805-8c5ac6009818 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.540450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.542148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.542819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.543300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.545782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2420e5183f7c4d44a8b43829e3d02ce0, user_id=f405dc73d17e4247917fadcab884bc52, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.546207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:57.546844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.550331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.551099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.580487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1115/2275] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:57.586064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.602084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a51f8-0d17-418e-abb4-e1be5e0f6cd6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.611445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.612248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.612681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.613109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.614585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.617203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.673762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1161/2276] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:57 2022] PUT /identity/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0/users/f405dc73d17e4247917fadcab884bc52/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:57.679987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.766148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1116/2277] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:57 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:57.769476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.798793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795e8b9-1295-4adc-a121-6acd03685899 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.884075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289c81-56e7-46c8-a2f1-6dc5dbb95884 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.914743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.919434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.919434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.919434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.919931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.920122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.920297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.920297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.920297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.920297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.921847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.922817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:57.934091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1162/2278] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:11:57.939224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:57.953416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959916e7-bc12-4bf1-99dd-402c832b1b18 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:57.961854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:57.963162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:57.963649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:57.964135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] PATH_INFO: `/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0/users/f405dc73d17e4247917fadcab884bc52/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:57.968698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2420e5183f7c4d44a8b43829e3d02ce0, user_id=f405dc73d17e4247917fadcab884bc52, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:57.975113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a5baa-52ad-4e24-a399-3ecc08a0e0e1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:58.012477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1163/2279] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:57 2022] PUT /identity/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0/users/f405dc73d17e4247917fadcab884bc52/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:11:58.042108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.043162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.044667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.099485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1117/2280] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:57 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:58.108411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:58.110003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] MFA Rules not processed for user `f405dc73d17e4247917fadcab884bc52`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:58.112086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:58.128888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631d81-2bf4-4e12-8d88-9795330679e4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:58.269750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:58.270536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.271043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.271345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.272086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:58.273845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:58.303828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1118/2281] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:58.304738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1164/2282] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:58.315019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:58.318174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:58.334215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730f352-e45a-45b9-92ad-e03e00d57028 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:58.343884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:58.344670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.345030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.361424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.361424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:58.361424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:58.365396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1119/2283] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:58.371214 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:58.391299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6072c-9b88-42b4-85bf-29fc98bc313d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:58.404547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:58.405474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.405767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.406051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] PATH_INFO: `/v3/projects/c688a70acf70444b9cbe212013b0b3b0/users/1030d2233d074c328fdfc75c2c99d553/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.415735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:58.439208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc8767-acb0-40a9-9a0c-d635c754b3ae None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:58.446438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:58.447367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.448039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.449512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.453916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:58.461157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c688a70acf70444b9cbe212013b0b3b0, user_id=1030d2233d074c328fdfc75c2c99d553, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:58.465212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:58.548963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:58.550608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76506694-3e6b-41c4-bd1e-ff47f6e27456 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:58.562718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1165/2284] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:58.611786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1120/2285] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:58 2022] PUT /identity/v3/projects/c688a70acf70444b9cbe212013b0b3b0/users/1030d2233d074c328fdfc75c2c99d553/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:58.642774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.642774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.642774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.698756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] MFA Rules not processed for user `1030d2233d074c328fdfc75c2c99d553`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:58.701498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:58.811607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1166/2286] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:58.817658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:58.948148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fa06-32a0-4863-8883-90e623766457 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:58.959366 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:58.960853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.961455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.962255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.968973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:58.968973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.123356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:59.131591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:59.136117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1121/2287] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:58 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:59.159176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb172f-f565-4e3d-bd9c-61bbf56df70a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:59.294691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:59.295177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.295628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.295911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.296626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:59.298875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.521986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1167/2288] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:59 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:59.528612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:59.552183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4d7ba-c079-4b8d-a2e2-f55b42f96fe3 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:59.562438 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:59.563424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.563887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.564331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.565742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:59.569517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.601830 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1122/2289] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:59.612203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:59.663506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad532-1565-4e15-91fe-391ffff571ea admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:59.678507 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:59.680558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.682689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.683510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.690218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:59.696920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a3501-2952-400e-b836-3cb6d5e84158 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.724470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1168/2290] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:59.730731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:59.748128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5bf4f-748b-4a69-ac9d-2046d0aa6491 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:59.756314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:59.757352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.757808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.758555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] PATH_INFO: `/v3/projects/2c7126604ee34b8ca0b0195e28554860/users/090af5087bb44514829cd375a6a44316/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.790377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7126604ee34b8ca0b0195e28554860, user_id=090af5087bb44514829cd375a6a44316, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:59.797471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.949073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.949387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.949774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.953364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1123/2291] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:59 2022] PUT /identity/v3/projects/2c7126604ee34b8ca0b0195e28554860/users/090af5087bb44514829cd375a6a44316/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:00.011590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] MFA Rules not processed for user `090af5087bb44514829cd375a6a44316`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:00.015728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:00.209000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:00.213621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1169/2292] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:00.319583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda6a1-4847-4fab-9bb5-24f8be34b607 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:00.330132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:00.331168 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:00.332211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:00.333030 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:00.334361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:00.339932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:00.536671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1124/2293] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:00 2022] POST /identity/v3/projects => generated 375 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:00.539689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:00.573281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2f0b-8c49-464a-a6e0-f438185201b2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:00.685239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:00.686185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:00.686685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:00.687327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:00.688034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:00.690191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:00.817681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1170/2294] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:00 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:00.823684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:00.838619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:00.843116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5239d-4719-44cf-8af1-3fa5dd6a1526 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:00.851834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:00.852562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:00.852847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:00.853127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:00.853825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:00.855538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:00.873547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1125/2295] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:00.878427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:00.895664 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835eca-1205-4b33-b0d1-b2eebfa45dbd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:00.910503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:00.911205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:00.911488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:00.911763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] PATH_INFO: `/v3/projects/f43194e805fe43dea0d3408d9ed519b6/users/ac4a65978af749ce8d7dd8816321fe3b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:00.951936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43194e805fe43dea0d3408d9ed519b6, user_id=ac4a65978af749ce8d7dd8816321fe3b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:00.959990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:01.153270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1171/2296] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:00 2022] PUT /identity/v3/projects/f43194e805fe43dea0d3408d9ed519b6/users/ac4a65978af749ce8d7dd8816321fe3b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:01.157725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:01.174495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161ff3b-c9ff-47c1-a9f3-ea21d5a6dfbd admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:01.260473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:01.261574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:01.261960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:01.262148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:01.265420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:01.271062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffb602-5d8c-4196-beb6-f1feb5207e19 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:01.295157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1126/2297] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:01.300834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:01.316588 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6a17-9c86-45a5-be6e-8f32c7c7da93 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:01.322396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:01.323126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:01.323574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:01.323772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] PATH_INFO: `/v3/projects/f43194e805fe43dea0d3408d9ed519b6/users/ac4a65978af749ce8d7dd8816321fe3b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:01.326632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43194e805fe43dea0d3408d9ed519b6, user_id=ac4a65978af749ce8d7dd8816321fe3b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:01.329523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:01.343159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1172/2298] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:01 2022] PUT /identity/v3/projects/f43194e805fe43dea0d3408d9ed519b6/users/ac4a65978af749ce8d7dd8816321fe3b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:01.355068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:01.355342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:01.356108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:01.390813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] MFA Rules not processed for user `ac4a65978af749ce8d7dd8816321fe3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:01.392337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:01.496088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1127/2299] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:01.506775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:01.593793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec806-f98a-45d5-95de-de2d07ffb061 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:01.600238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:01.601070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:01.601536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:01.601928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:01.671920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:01.673573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:01.683556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1173/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:02.853295 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:02.854787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:02.981051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcc02e-d70f-4f56-85a5-e65c8e26e044 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:02.996601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:03.000669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:03.000669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:03.000669 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] PATH_INFO: `/v3/users/767b821543304ef6807895251bfb0589` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:03.013059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767b821543304ef6807895251bfb0589)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:03.013059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:03.075913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:03.078101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:03.105241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd877-6a42-40e9-ae84-f46b82ad40cd service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:03.122210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:03.130525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:03.131061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:03.131556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:03.134633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:03.219294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:03.220971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade03a5-aefe-4684-87cc-04a0745a0773 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:03.231206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1174/2301] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:03.450941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767b821543304ef6807895251bfb0589'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:03.621425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:03.623282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767b821543304ef6807895251bfb0589'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:03.624346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767b821543304ef6807895251bfb0589'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:03.638465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767b821543304ef6807895251bfb0589'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:03.658619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767b821543304ef6807895251bfb0589'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:03.666791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1128/2302] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:02 2022] DELETE /identity/v3/users/767b821543304ef6807895251bfb0589 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:03.672623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465656c6-bd48-4d43-a12f-082485818af0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:03.673095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465656c6-bd48-4d43-a12f-082485818af0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:03.673548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465656c6-bd48-4d43-a12f-082485818af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:03.695605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-465656c6-bd48-4d43-a12f-082485818af0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:03.700830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-465656c6-bd48-4d43-a12f-082485818af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:03.782483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1175/2303] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:03.795005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:03.797452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:03.905631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb3b6-1d39-436a-940a-99776abe6860 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:03.910409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:03.911040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:03.911322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:03.911596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:03.923781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:03.925634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:03.937774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1129/2304] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:04.208491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:04.209249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:04.209360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:04.240356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] MFA Rules not processed for user `4e2982e7cf254d408ebadaa62555b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:04.243407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:04.343560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1176/2305] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:04.653919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:04.656286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:04.677997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3db08-779b-4c6d-8c0b-556a6fc04f97 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:04.683747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:04.685334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:04.685797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:04.686251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] PATH_INFO: `/v3/projects/e44e8a23d4a641339ec3ab8bf3718b51` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:04.687567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44e8a23d4a641339ec3ab8bf3718b51)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:04.689600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:04.701975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:04.976232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44e8a23d4a641339ec3ab8bf3718b51', 'request_id': 'req-4b97c858-12f7-4f42-8427-fd3ecf5f4671'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.139321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44e8a23d4a641339ec3ab8bf3718b51', 'request_id': 'req-4b97c858-12f7-4f42-8427-fd3ecf5f4671'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.147468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44e8a23d4a641339ec3ab8bf3718b51', 'request_id': 'req-4b97c858-12f7-4f42-8427-fd3ecf5f4671'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.162733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] The token cache is being invalidate because project e44e8a23d4a641339ec3ab8bf3718b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:05.163488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.164659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.167462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1130/2306] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:04 2022] DELETE /identity/v3/projects/e44e8a23d4a641339ec3ab8bf3718b51 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:05.177434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:05.200646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa80e5-613c-4b49-941e-03fe2047571b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:05.448541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:05.449810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:05.451190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:05.451867 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] PATH_INFO: `/v3/users/3170ce48ec784eb3bce4f5a483f929a3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:05.454575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3170ce48ec784eb3bce4f5a483f929a3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:05.457629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:05.749969 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3170ce48ec784eb3bce4f5a483f929a3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.785100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:05.786744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:05.883934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97c858-12f7-4f42-8427-fd3ecf5f4671 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:05.888458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:05.889174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:05.889532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:05.889717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:05.891644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:05.916928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3170ce48ec784eb3bce4f5a483f929a3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.919261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3170ce48ec784eb3bce4f5a483f929a3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:05.987914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3170ce48ec784eb3bce4f5a483f929a3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:06.003436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3170ce48ec784eb3bce4f5a483f929a3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:06.028879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1177/2307] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:05 2022] DELETE /identity/v3/users/3170ce48ec784eb3bce4f5a483f929a3 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:06.101844 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:06.106596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:06.155130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1131/2308] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:06.399078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:06.401683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:06.555011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add786ea-e95b-4d77-80b5-38ecaf9b910c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:06.562913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:06.564020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:06.564559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:06.565051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:06.567878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:06.741379 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:06.743176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b492-b4d4-4a7d-bedd-44cf4348e6f7 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:06.757899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1178/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:07.029361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:07.031321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:07.048203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484994a9-44af-44d7-884d-007ce39818a0 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:07.133480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:07.134181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.134335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.134608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] PATH_INFO: `/v3/projects/7a8b249f9d214b12b04cd06f377cbb99` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.135802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8b249f9d214b12b04cd06f377cbb99)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:07.138819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:07.322572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8b249f9d214b12b04cd06f377cbb99', 'request_id': 'req-99ddb9d0-3822-4b64-ba43-885be57c36bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:07.438711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8b249f9d214b12b04cd06f377cbb99', 'request_id': 'req-99ddb9d0-3822-4b64-ba43-885be57c36bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:07.446897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8b249f9d214b12b04cd06f377cbb99', 'request_id': 'req-99ddb9d0-3822-4b64-ba43-885be57c36bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:07.458711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] The token cache is being invalidate because project 7a8b249f9d214b12b04cd06f377cbb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:07.459002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:07.459724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-99ddb9d0-3822-4b64-ba43-885be57c36bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:07.461325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1132/2310] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:07 2022] DELETE /identity/v3/projects/7a8b249f9d214b12b04cd06f377cbb99 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:07.466629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.466922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.467202 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.488361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:07.489620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:07.556836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1179/2311] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:07.565984 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.566294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.566537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.589227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:07.590145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:07.600779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1133/2312] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:07.605267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:07.623058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddb2b8-70f2-41b3-b3a3-5d31f6a15464 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:07.628857 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:07.629568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.629849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.630123 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.630784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:07.631089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:07.632717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:07.645427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1180/2313] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:07.650378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:07.662280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dabac-4930-4705-9b34-ab8f940e8d4b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:07.668088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:07.671508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.671508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.671508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.671508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:07.672631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:07.781856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1134/2314] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:07 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:07.782281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:07.793616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e1ca0-d055-4cfc-ac35-60451c08f6ba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:07.891264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:07.902086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:07.902452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:07.903448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:07.905060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:07.907263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.074435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1181/2315] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:07 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:08.079053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.092433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11086f35-b70e-49be-801a-27cfd66fa347 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:08.102006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:08.103178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.103691 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.104470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.105787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:08.109296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.128563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1135/2316] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:08.166839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.181204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6abe3-8cd0-41de-ae1c-fa137a52249f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:08.187080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:08.187724 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.188011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.188294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.189071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:08.190735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace3488-5a45-4412-9f4a-7a3a94ec4249 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.203405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1182/2317] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:08.207676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.223703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31038-941d-4152-bac3-65b94c833ba0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:08.230170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:08.230766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.231110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.231443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] PATH_INFO: `/v3/projects/b59cdb51491b40fe8dac57999cf29142/users/2f5621a75d064bcd85fd6eb5f13c783c/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.247189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59cdb51491b40fe8dac57999cf29142, user_id=2f5621a75d064bcd85fd6eb5f13c783c, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:08.252896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.396498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1136/2318] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:08 2022] PUT /identity/v3/projects/b59cdb51491b40fe8dac57999cf29142/users/2f5621a75d064bcd85fd6eb5f13c783c/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:08.409341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.409631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.409911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.438214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] MFA Rules not processed for user `2f5621a75d064bcd85fd6eb5f13c783c`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:08.439441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:08.509224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1183/2319] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:08.514588 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.583108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbdf8e-8add-44e6-bc31-02dabea34562 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:08.593436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:08.594088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.594554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.595249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.596147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:08.598707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.723330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1137/2320] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:08 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:08.724590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:08.726754 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.739768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a006-99d1-4f66-8691-fd5a1bcb2680 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:08.826825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:08.827444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:08.827725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:08.827997 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:08.828668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:08.830603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:08.954307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:08.964196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:09.041239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37562a-e514-4a1c-833f-5c4db9c7543a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.046205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.047146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.047427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.047719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.049541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:09.114180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1184/2321] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:08 2022] POST /identity/v3/users => generated 294 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:09.118089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.130560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.132138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.143488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ff7f-8363-44fe-be1b-8478bf576454 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.144541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1138/2322] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:09.151891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.152771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.162567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.162567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.162567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.163117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.176880 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1185/2323] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:09.181425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.197977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a3844-1f1f-4cb2-80fe-8f35346e7b4e service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.213398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.217591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.217881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.218199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.219230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.221131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11bd1d-bbf4-4cdc-b2b2-17d5a1bf8ba9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.234914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1139/2324] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:09.253862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.265512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daa37-db00-4454-b893-6faf59ffc5f4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.270268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.271056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.271345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.271620 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] PATH_INFO: `/v3/projects/20b7cfdef0ae4088bd72b85509bb02b3/users/ba5425e985034a16812d6830d2889436/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.289487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b7cfdef0ae4088bd72b85509bb02b3, user_id=ba5425e985034a16812d6830d2889436, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.292146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.411773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1186/2325] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:09 2022] PUT /identity/v3/projects/20b7cfdef0ae4088bd72b85509bb02b3/users/ba5425e985034a16812d6830d2889436/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:09.422109 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.422439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.425778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.460713 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] MFA Rules not processed for user `ba5425e985034a16812d6830d2889436`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:09.462001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:09.542698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1140/2326] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:09.548013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.627454 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3491ef8-0344-4189-a20e-4ad09860a51c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.632675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.633316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.633599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.633873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.634543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.636730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.760574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1187/2327] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:09 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:09.765892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.779226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7121c3-9826-4369-a2f9-f58410cff17f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.856898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.857894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.858343 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.858718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.859672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.862928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:09.871601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:10.079328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1141/2328] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:09 2022] POST /identity/v3/users => generated 300 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:10.083674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.096951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1c74-ee64-45de-aa33-2ed498d29ac3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:10.102804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:10.103651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.103938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.104214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.105058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:10.107449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.120110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1188/2329] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:10.127889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.148069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b32a8-751a-4df1-b7fb-c1a8454db429 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:10.156472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:10.157606 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.163336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.163336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] PATH_INFO: `/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff/users/f059d77034394ddbbca013ccc4e558cf/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.188705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8e51006065429bb6e5c6c9f1f230ff, user_id=f059d77034394ddbbca013ccc4e558cf, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:10.197120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.381268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1142/2330] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:10 2022] PUT /identity/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff/users/f059d77034394ddbbca013ccc4e558cf/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:10.388598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.414782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471969b-1fb8-4709-8006-1cc24bca46af admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:10.543565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:10.544869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.545383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.545768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.546685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:10.548945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5424da-5abe-4468-80fd-1fa4483dd717 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.564746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1189/2331] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:10.569507 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.583419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34331f70-905d-4285-b52d-0465aa071931 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:10.589202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:10.589996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.590311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.591248 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] PATH_INFO: `/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff/users/f059d77034394ddbbca013ccc4e558cf/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.593694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8e51006065429bb6e5c6c9f1f230ff, user_id=f059d77034394ddbbca013ccc4e558cf, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:10.596412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.608916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1143/2332] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:10 2022] PUT /identity/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff/users/f059d77034394ddbbca013ccc4e558cf/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:10.633031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.633031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.633031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.664904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] MFA Rules not processed for user `f059d77034394ddbbca013ccc4e558cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:10.666186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:10.745801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1190/2333] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:10.758207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.830873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd70e6-795c-492e-baec-6aef5f99e2c9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:10.835393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:10.836191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.836626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.837301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.848633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:10.850106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.864067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1144/2334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:12.803176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:12.814865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be483c-9fa8-4b69-990c-c4eef6cc2608 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:12.818885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:12.819516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:12.819799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:12.820075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:12.937327 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:12.938991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617f66-6213-4d80-9a39-b281fe8ad497 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:12.956287 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1191/2335] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:13.571645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:14.301487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.322493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:14.352688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:14.513946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110cb1a-2c31-4392-ab15-7df07566e056 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.519306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.520072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.520435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.521050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] PATH_INFO: `/v3/users/4a8be11c4c6d42009a7320dc4640e727` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.522621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8be11c4c6d42009a7320dc4640e727)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.524918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.975788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8be11c4c6d42009a7320dc4640e727'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.089732 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8be11c4c6d42009a7320dc4640e727'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.092601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8be11c4c6d42009a7320dc4640e727'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.157499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8be11c4c6d42009a7320dc4640e727'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.205899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8be11c4c6d42009a7320dc4640e727'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.258315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1145/2336] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:14 2022] DELETE /identity/v3/users/4a8be11c4c6d42009a7320dc4640e727 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:15.261221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.262086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.264872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.308335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:15.311375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.466356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1192/2337] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:15.481549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:15.485909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.592792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c38e11-e74b-44af-be60-f087135a6bf1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:15.597570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:15.598425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.598698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.599188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.610599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:15.612385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:15.632566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1146/2338] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:16.375380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:16.377258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:16.403638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0a41d-7480-4ad1-9864-4ba9525a3394 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:16.411746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:16.413285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:16.413790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:16.414297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] PATH_INFO: `/v3/users/1030d2233d074c328fdfc75c2c99d553` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:16.416685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1030d2233d074c328fdfc75c2c99d553)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:16.421557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:16.758446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:16.760369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:16.784553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0125-cacc-4656-95f4-ffa11139d726 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:16.796327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:16.798022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:16.798989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:16.799658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] PATH_INFO: `/v3/projects/38807187bdf34cdd80aae712037fdff4` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:16.803266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38807187bdf34cdd80aae712037fdff4)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:16.807492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:16.811169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:16.814063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1030d2233d074c328fdfc75c2c99d553'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.896548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1030d2233d074c328fdfc75c2c99d553'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.897636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1030d2233d074c328fdfc75c2c99d553'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.917976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1030d2233d074c328fdfc75c2c99d553'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.940134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a3c8b8c0-a5c8-4427-87bd-6cfb51de4913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1030d2233d074c328fdfc75c2c99d553'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.952147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1193/2339] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:16 2022] DELETE /identity/v3/users/1030d2233d074c328fdfc75c2c99d553 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:16.957518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:16.957960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:16.958334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:16.987208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:16.988458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:17.000314 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38807187bdf34cdd80aae712037fdff4', 'request_id': 'req-ee704e3a-8c70-4983-b959-45fe018269b4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.083818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1194/2340] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:17.097113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:17.099623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:17.158415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38807187bdf34cdd80aae712037fdff4', 'request_id': 'req-ee704e3a-8c70-4983-b959-45fe018269b4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.171157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38807187bdf34cdd80aae712037fdff4', 'request_id': 'req-ee704e3a-8c70-4983-b959-45fe018269b4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.192617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] The token cache is being invalidate because project 38807187bdf34cdd80aae712037fdff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:17.197007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.197007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.197007 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1147/2341] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:16 2022] DELETE /identity/v3/projects/38807187bdf34cdd80aae712037fdff4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:17.201294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:17.201590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7bbdb-a766-467e-8b69-16da3071711f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:17.203179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:17.207380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:17.208167 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:17.208726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:17.209228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:17.211509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:17.221824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee704e3a-8c70-4983-b959-45fe018269b4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:17.226875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:17.228500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:17.228780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:17.229493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:17.229996 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:17.230348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] PATH_INFO: `/v3/users/bdc21a5107ad4f11b7bcedca70f3dde6` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:17.232359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc21a5107ad4f11b7bcedca70f3dde6)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:17.235066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:17.241915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1195/2342] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:17.615126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc21a5107ad4f11b7bcedca70f3dde6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.730171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc21a5107ad4f11b7bcedca70f3dde6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.731631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc21a5107ad4f11b7bcedca70f3dde6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.750203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:17.758623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc21a5107ad4f11b7bcedca70f3dde6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.801543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc21a5107ad4f11b7bcedca70f3dde6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.816569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1148/2343] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:17 2022] DELETE /identity/v3/users/bdc21a5107ad4f11b7bcedca70f3dde6 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:18.054064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.056164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:18.076373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4027-9e88-45ba-97b6-767e0ab3b25f service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.213864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.214916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.215909 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.216368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] PATH_INFO: `/v3/projects/c688a70acf70444b9cbe212013b0b3b0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.219065 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c688a70acf70444b9cbe212013b0b3b0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.222396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.478749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c688a70acf70444b9cbe212013b0b3b0', 'request_id': 'req-5efbe91f-e41a-4b33-9213-5f05daffd634'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.605591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c688a70acf70444b9cbe212013b0b3b0', 'request_id': 'req-5efbe91f-e41a-4b33-9213-5f05daffd634'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.618414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c688a70acf70444b9cbe212013b0b3b0', 'request_id': 'req-5efbe91f-e41a-4b33-9213-5f05daffd634'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.640116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] The token cache is being invalidate because project c688a70acf70444b9cbe212013b0b3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:18.640463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.641612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.645137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1196/2344] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:18 2022] DELETE /identity/v3/projects/c688a70acf70444b9cbe212013b0b3b0 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:18.652829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.654885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.656182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:18.657246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:18.688287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5c9cb-440a-4a2f-91fe-7bee0b8d00d0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.812679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbe91f-e41a-4b33-9213-5f05daffd634 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.821028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.822425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.822767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.823111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] PATH_INFO: `/v3/users/090af5087bb44514829cd375a6a44316` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.828567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.828872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090af5087bb44514829cd375a6a44316)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.829637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.830052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.830338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] PATH_INFO: `/v3/projects/dcac3d15882d470cbc68caa573fb08e7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.831790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcac3d15882d470cbc68caa573fb08e7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.833992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.838254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.201728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090af5087bb44514829cd375a6a44316'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.204402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcac3d15882d470cbc68caa573fb08e7', 'request_id': 'req-507890e0-7570-46d2-9c3b-9ca8648cd7f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.249943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:19.292392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090af5087bb44514829cd375a6a44316'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.294512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090af5087bb44514829cd375a6a44316'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.308504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090af5087bb44514829cd375a6a44316'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.331033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090af5087bb44514829cd375a6a44316'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.340407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1149/2345] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:18 2022] DELETE /identity/v3/users/090af5087bb44514829cd375a6a44316 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:19.400217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcac3d15882d470cbc68caa573fb08e7', 'request_id': 'req-507890e0-7570-46d2-9c3b-9ca8648cd7f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.408130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcac3d15882d470cbc68caa573fb08e7', 'request_id': 'req-507890e0-7570-46d2-9c3b-9ca8648cd7f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.423312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] The token cache is being invalidate because project dcac3d15882d470cbc68caa573fb08e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:19.423985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.424939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.427064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1197/2346] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:18 2022] DELETE /identity/v3/projects/dcac3d15882d470cbc68caa573fb08e7 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:19.438116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.440480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.532464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2686ae-8f64-43f7-8843-2156bbd3fa50 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.537890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.538563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.538847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.539174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] PATH_INFO: `/v3/users/f405dc73d17e4247917fadcab884bc52` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.540488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f405dc73d17e4247917fadcab884bc52)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.542468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.891097 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f405dc73d17e4247917fadcab884bc52'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.969812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.973971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.993781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f405dc73d17e4247917fadcab884bc52'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:19.995541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f405dc73d17e4247917fadcab884bc52'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.013271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f405dc73d17e4247917fadcab884bc52'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.047170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f405dc73d17e4247917fadcab884bc52'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.066155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1150/2347] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:19 2022] DELETE /identity/v3/users/f405dc73d17e4247917fadcab884bc52 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:20.149061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507890e0-7570-46d2-9c3b-9ca8648cd7f8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.247677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.248896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.248896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.249209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] PATH_INFO: `/v3/projects/2c7126604ee34b8ca0b0195e28554860` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.250523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7126604ee34b8ca0b0195e28554860)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.252767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:20.490145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7126604ee34b8ca0b0195e28554860', 'request_id': 'req-4ebd3d98-0164-46c7-99bc-f6a519d26f99'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.610285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7126604ee34b8ca0b0195e28554860', 'request_id': 'req-4ebd3d98-0164-46c7-99bc-f6a519d26f99'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.624002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7126604ee34b8ca0b0195e28554860', 'request_id': 'req-4ebd3d98-0164-46c7-99bc-f6a519d26f99'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.654862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] The token cache is being invalidate because project 2c7126604ee34b8ca0b0195e28554860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:20.655347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.656614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.659062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1198/2348] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:19 2022] DELETE /identity/v3/projects/2c7126604ee34b8ca0b0195e28554860 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:20.664057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:20.665980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.682053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32038e3-598c-4add-a579-08dd86d753e4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.771456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.772246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.772644 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.773082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] PATH_INFO: `/v3/users/ac4a65978af749ce8d7dd8816321fe3b` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.774643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4a65978af749ce8d7dd8816321fe3b)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.777833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:21.022006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:21.032063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.034746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:21.058532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3d98-0164-46c7-99bc-f6a519d26f99 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.069034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.070235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.070741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.071214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] PATH_INFO: `/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.072737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2420e5183f7c4d44a8b43829e3d02ce0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:21.075964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:21.121881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4a65978af749ce8d7dd8816321fe3b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.275683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2420e5183f7c4d44a8b43829e3d02ce0', 'request_id': 'req-8744cd3e-4fe2-46b9-8e64-3cae4b287518'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.288569 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4a65978af749ce8d7dd8816321fe3b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.289717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:21.291321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4a65978af749ce8d7dd8816321fe3b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.303979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4a65978af749ce8d7dd8816321fe3b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.324004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-346f4f9b-71dc-4e77-869e-70ce97ec274f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4a65978af749ce8d7dd8816321fe3b'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.334204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1151/2349] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:20 2022] DELETE /identity/v3/users/ac4a65978af749ce8d7dd8816321fe3b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:21.554305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2420e5183f7c4d44a8b43829e3d02ce0', 'request_id': 'req-8744cd3e-4fe2-46b9-8e64-3cae4b287518'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.564551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2420e5183f7c4d44a8b43829e3d02ce0', 'request_id': 'req-8744cd3e-4fe2-46b9-8e64-3cae4b287518'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.585533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] The token cache is being invalidate because project 2420e5183f7c4d44a8b43829e3d02ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:21.586026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.586825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.588460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1199/2350] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:21 2022] DELETE /identity/v3/projects/2420e5183f7c4d44a8b43829e3d02ce0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:21.596288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fbd3-3ddd-4b06-8fe4-20cf52e2db9b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.596921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fbd3-3ddd-4b06-8fe4-20cf52e2db9b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.597676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956fbd3-3ddd-4b06-8fe4-20cf52e2db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.636807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-c956fbd3-3ddd-4b06-8fe4-20cf52e2db9b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:21.639360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-c956fbd3-3ddd-4b06-8fe4-20cf52e2db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:21.654927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.657772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:21.736458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1152/2351] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:21.751215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.751774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.752281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.791408 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:21.795324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:21.799691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744cd3e-4fe2-46b9-8e64-3cae4b287518 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.816389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1153/2352] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:21.819842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.840457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303cc3a-1470-4b71-bdad-a028b313281b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.850319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.851558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.852352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.852887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.854601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:21.855533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:21.861127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:21.890924 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1154/2353] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:21.895891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.909708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d940d-5b32-4f88-bc1e-7ea1cfd54e0c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.915297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.916335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.916675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.916825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.919503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:21.927607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:21.943178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.944165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.944452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.944806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.946916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:22.097024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1155/2354] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:21 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:22.098671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:22.105726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:22.110334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:22.112621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:22.127457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1200/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:22.128701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:22.145715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ea17-0110-48ad-8f30-a28b8ce8b0ab service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:22.300235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4544-6870-4ce4-9ee7-bb1b1a863902 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:22.312416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:22.313546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:22.314233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:22.315131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:22.316597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:22.321023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:22.321023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:22.321023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:22.321023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] PATH_INFO: `/v3/projects/f43194e805fe43dea0d3408d9ed519b6` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:22.321662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:22.321975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43194e805fe43dea0d3408d9ed519b6)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:22.322953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:22.894594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1201/2356] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:22 2022] POST /identity/v3/users => generated 292 bytes in 766 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:22.901497 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:22.907320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43194e805fe43dea0d3408d9ed519b6', 'request_id': 'req-cbd5327a-1505-4faf-94d0-441201c1b7b3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.915016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85331f-11f5-44b9-be75-053c2390a657 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:22.992904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43194e805fe43dea0d3408d9ed519b6', 'request_id': 'req-cbd5327a-1505-4faf-94d0-441201c1b7b3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.003290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.004347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.004859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.005555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.006765 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.009395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43194e805fe43dea0d3408d9ed519b6', 'request_id': 'req-cbd5327a-1505-4faf-94d0-441201c1b7b3'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.010741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.039290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1202/2357] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:23.040301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] The token cache is being invalidate because project f43194e805fe43dea0d3408d9ed519b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:23.040780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.041873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cbd5327a-1505-4faf-94d0-441201c1b7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.044087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.044371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1156/2358] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:22 2022] DELETE /identity/v3/projects/f43194e805fe43dea0d3408d9ed519b6 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:23.046899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.053067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6524-414d-4df6-a50a-d3afe9c052c9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.054012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6524-414d-4df6-a50a-d3afe9c052c9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.058865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e6524-414d-4df6-a50a-d3afe9c052c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.069751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349536-9503-4fd2-9b90-748e7e6b6350 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.078274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.080842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.081427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.082372 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.083274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.086186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.111951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-681e6524-414d-4df6-a50a-d3afe9c052c9 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.114141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-681e6524-414d-4df6-a50a-d3afe9c052c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.117608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1203/2359] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:23.122974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.133913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca262-bee5-4ce5-bce6-4b2409d87dce admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.139834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.140059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1157/2360] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:23.140602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.140883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.141166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] PATH_INFO: `/v3/projects/8753ea6c257c409183de36d348122985/users/f47731759ec445fa856d28afbf13e300/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.164303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.164303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.164303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.165147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8753ea6c257c409183de36d348122985, user_id=f47731759ec445fa856d28afbf13e300, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.165147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92657b-73a5-4763-b0c3-602ac7ddae16 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.185836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.187395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.195735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1158/2361] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:23.200831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.215062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a871-ff2d-4558-b7ba-1185e62f5bdd None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.223298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.223916 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.224238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.224481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.225355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:23.225611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.227253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.251169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1159/2362] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:12:23.259252 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.277521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bfab7-0854-4e8d-b941-a6a2c662f442 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.288774 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1204/2363] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:23 2022] PUT /identity/v3/projects/8753ea6c257c409183de36d348122985/users/f47731759ec445fa856d28afbf13e300/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:23.302278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.303262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.304036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.413316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] MFA Rules not processed for user `f47731759ec445fa856d28afbf13e300`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.413316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.421736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.422992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.423595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.424979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.425964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.428065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.514248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1205/2364] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:23.535425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.539050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.630745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1160/2365] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/projects => generated 371 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:23.635155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.641347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186dbcd-d5fb-4289-a54e-06f02416e27f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.711221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.711809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.712114 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.712387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.735574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9cb09-e4ed-4286-b643-f8342a258c1d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.743487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.744281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.744764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.745250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.746370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.749413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.799694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.801414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.812064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1206/2366] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:23.878818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1161/2367] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:23.883174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.896925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9852-9670-45d5-b468-a3765158d73e service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.907920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.908830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.909366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.909749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.910645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.912928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.936775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.940650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1207/2368] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:23.954096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b82e-7fd8-46d0-a8ed-d8c36fdfa741 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.961778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.962702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.963182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.970052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.970052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.970052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece2cc5-4820-4972-bb3d-d494c1432099 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.991200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1162/2369] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:23.997883 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:24.015336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97ed45-a6dd-4852-989d-14331b969688 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:24.022330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:24.024069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:24.024069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:24.024069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] PATH_INFO: `/v3/projects/7b3d5ff6a3d14833874b090af2d5c090/users/711396a88956426c9eb554f518230a8a/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:24.046773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3d5ff6a3d14833874b090af2d5c090, user_id=711396a88956426c9eb554f518230a8a, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:24.050396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:24.152612 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1208/2370] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:23 2022] PUT /identity/v3/projects/7b3d5ff6a3d14833874b090af2d5c090/users/711396a88956426c9eb554f518230a8a/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:24.163689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:24.164321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:24.164446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:24.187819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:24.189131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:24.264336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1163/2371] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:24.275775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:24.284776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:24.307545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:24.367365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a600bd5-f1c9-4331-a95b-b4bbd9caf732 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:24.372435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:24.373113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:24.373423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:24.373697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:24.387134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:24.393802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455961f-a282-408e-af0b-4e64f36aa656 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:24.400393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1209/2372] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:24.448831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:27.317284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:27.707860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:27.708972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:27.724946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507eb17-fc20-4c43-96fd-703fbd4f960c None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:27.734915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:27.736036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:27.736445 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:27.737193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] PATH_INFO: `/v3/users/aa5985f473da46d698a8912e0463603c` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:27.739753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5985f473da46d698a8912e0463603c)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:27.743329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:27.912264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:28.176448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5985f473da46d698a8912e0463603c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:28.426197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5985f473da46d698a8912e0463603c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:28.427368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5985f473da46d698a8912e0463603c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:28.456213 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5985f473da46d698a8912e0463603c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:28.470197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5985f473da46d698a8912e0463603c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:28.479986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1164/2373] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:27 2022] DELETE /identity/v3/users/aa5985f473da46d698a8912e0463603c => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:28.486156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:28.486858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:28.487366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:28.512850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:28.514677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:28.613896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1210/2374] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:28.632998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:28.634132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:28.835596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbe6fa-3072-489b-b088-842628558de8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:28.835596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:28.835596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:28.835596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:28.836175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:28.842217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:28.845847 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f89b66-8188-4638-9f5c-2ec950908cc4 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:28.867690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1165/2375] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:28.960307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:28.963480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:28.998539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09eee3-8736-4604-a620-c4396ced704a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:29.010974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:29.014553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:29.014931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:29.015250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] PATH_INFO: `/v3/users/f47731759ec445fa856d28afbf13e300` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:29.018518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47731759ec445fa856d28afbf13e300)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:29.025232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:29.418330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47731759ec445fa856d28afbf13e300'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:29.495924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47731759ec445fa856d28afbf13e300'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:29.497430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47731759ec445fa856d28afbf13e300'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:29.544385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47731759ec445fa856d28afbf13e300'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:29.565547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47731759ec445fa856d28afbf13e300'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:29.594591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1211/2376] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:28 2022] DELETE /identity/v3/users/f47731759ec445fa856d28afbf13e300 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:29.600631 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:29.601512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:29.602031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:29.645044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:29.646656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:29.753563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1166/2377] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:29.766932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:29.768675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:29.804720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:29.807671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:29.835208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b59217-b5e0-4d7c-8ed8-4bf7f5d23cdf None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:29.842715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:29.843506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:29.843923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:29.844290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] PATH_INFO: `/v3/projects/9e164d050e9e42c787b2d182edaad160` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:29.845861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e164d050e9e42c787b2d182edaad160)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:29.847979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:29.917030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356d980-a4da-4f77-a319-9ebd9142837a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:29.935221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:29.936626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:29.937530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:29.937530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:29.959279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:30.135322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a9cdb-9bc5-4d27-b8b0-0d97a5f45fb6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:30.135322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1212/2378] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:30.214425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e164d050e9e42c787b2d182edaad160', 'request_id': 'req-cc4083e5-2c93-4120-a057-a89f38e926bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:30.318872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e164d050e9e42c787b2d182edaad160', 'request_id': 'req-cc4083e5-2c93-4120-a057-a89f38e926bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:30.342850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e164d050e9e42c787b2d182edaad160', 'request_id': 'req-cc4083e5-2c93-4120-a057-a89f38e926bc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:30.391413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] The token cache is being invalidate because project 9e164d050e9e42c787b2d182edaad160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:30.391413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:30.391413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-cc4083e5-2c93-4120-a057-a89f38e926bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:30.402218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1167/2379] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:29 2022] DELETE /identity/v3/projects/9e164d050e9e42c787b2d182edaad160 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:30.403343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:30.403716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:30.404076 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:30.465662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:30.475106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:30.701233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1213/2380] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:30.710382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:30.711875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:30.712192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:30.767871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:30.773723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:30.788841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1168/2381] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:30.794029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:30.813091 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1741-dccd-4bab-b9ab-d29b94f3f9e1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:30.816544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:30.820003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:30.820320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:30.820879 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:30.822901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:30.823213 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:30.824292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:30.825317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:30.827389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:30.847447 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1214/2382] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:30.855735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec4ed8-fa7a-404c-b143-b62528547549 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:30.855889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:30.864427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:30.866104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:30.866398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:30.866683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] PATH_INFO: `/v3/projects/8753ea6c257c409183de36d348122985` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:30.868008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8753ea6c257c409183de36d348122985)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:30.870729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:30.873227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a076-7079-46b8-a8b8-e0889022e6b5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:30.881942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:30.883413 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:30.888611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:30.888611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:30.888611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:30.889509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.080667 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8753ea6c257c409183de36d348122985', 'request_id': 'req-11157ac6-c427-4722-9947-44ed6e1bfd93'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.124682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1215/2383] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:30 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:31.124682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.127403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.167406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8753ea6c257c409183de36d348122985', 'request_id': 'req-11157ac6-c427-4722-9947-44ed6e1bfd93'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.208708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8753ea6c257c409183de36d348122985', 'request_id': 'req-11157ac6-c427-4722-9947-44ed6e1bfd93'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.233993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] The token cache is being invalidate because project 8753ea6c257c409183de36d348122985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:31.234969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.236476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.239596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1169/2384] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:30 2022] DELETE /identity/v3/projects/8753ea6c257c409183de36d348122985 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:31.245890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e282d-1601-4ca2-aacf-5b2a7e2357ed admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.248923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.252142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.252382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.253184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.253820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.254180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] PATH_INFO: `/v3/users/2f5621a75d064bcd85fd6eb5f13c783c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.255764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5621a75d064bcd85fd6eb5f13c783c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.258164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.369538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11157ac6-c427-4722-9947-44ed6e1bfd93 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.378124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.379099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.379410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.379672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.380328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.382614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e536d-915b-4ee1-80ee-10514fd84320 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.533162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1170/2385] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:31 2022] POST /identity/v3/users => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:31.535390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.535978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.536472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.563533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:31.566417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:31.568297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.580850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1171/2386] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:31.585340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.599080 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5621a75d064bcd85fd6eb5f13c783c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.601340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debc5fa-4cd0-4353-9b60-40ca1b258d37 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.609136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.609974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.610354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.610745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.611550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.613483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ab816-084e-45c0-854d-d60b779be73b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.633112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1172/2387] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:31.633112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.633112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.633112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.658592 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:31.660710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.676484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1173/2388] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:31.676484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.685407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5621a75d064bcd85fd6eb5f13c783c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.687690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca96cc-76de-45bf-851e-14b8202848ab None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.690075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5621a75d064bcd85fd6eb5f13c783c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.695789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.696664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.697092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.697783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.699179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.701802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.719062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1174/2389] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:31.719062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.720182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.727697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5621a75d064bcd85fd6eb5f13c783c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.738149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4584-1b6e-44e3-9824-14c9cc14cab2 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.740015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5621a75d064bcd85fd6eb5f13c783c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:31.746949 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.749846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.750193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.750649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.751683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:31.752006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.753728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6f9a0-3a1b-4a04-a7e0-97d4771fbac3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.757251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1216/2390] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:31 2022] DELETE /identity/v3/users/2f5621a75d064bcd85fd6eb5f13c783c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:31.758231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.763576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.776133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1175/2391] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:31.778471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.778980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.779704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.811674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:31.815136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:31.885253 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0a793-c4a4-4bef-b81f-e17c69d4312d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.892291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.893322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.893594 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.894190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] PATH_INFO: `/v3/projects/0f873325b355496a953a90409cbff58f/users/a0b10190661e4bb0a75a9e1726a41d6a/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.916271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f873325b355496a953a90409cbff58f, user_id=a0b10190661e4bb0a75a9e1726a41d6a, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.921733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:31.962008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1176/2392] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:31.963595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:31.985960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb3bb2-9e00-4ebf-a7cc-f3709dcff561 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:31.993342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:31.994099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:31.994515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:31.994823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:31.995759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:31.998223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bfabc-86fb-4e76-8e7c-7aedb7d776c4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.117821 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1217/2393] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:31 2022] PUT /identity/v3/projects/0f873325b355496a953a90409cbff58f/users/a0b10190661e4bb0a75a9e1726a41d6a/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:32.119193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.121775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:32.153324 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:32.163048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1177/2394] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:31 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:32.170555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.170555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.170555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.244311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] MFA Rules not processed for user `a0b10190661e4bb0a75a9e1726a41d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:32.248953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:32.263059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05ecd-3deb-4d40-9cd7-68b83c097ece admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.368178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.368746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.369028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.369306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.413434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1178/2395] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:32.416461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.468733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.471009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.506889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1218/2396] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:32.509855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.513937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:32.603289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c16f79-07e9-4905-9bb3-8d4b674ee2ba None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.618018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.620181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.624284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.625519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.627167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.631616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200b1e-5fcb-47fb-b0b8-319e3c4c6540 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.632371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.636227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.637260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.637790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.638176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.648924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.650647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.662910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1219/2397] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:32.721485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.742165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e96dc-e1e1-4474-a1f1-c274bf457ba7 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.750869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.752103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.753128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.753279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] PATH_INFO: `/v3/users/a0b10190661e4bb0a75a9e1726a41d6a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.755320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b10190661e4bb0a75a9e1726a41d6a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.757083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.768643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1179/2398] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:32 2022] POST /identity/v3/users => generated 286 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:32.770939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.791135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12c9f5-f132-4e27-a7ee-fe5a42eb4759 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.808186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.809840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.810310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.811099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.811993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.815131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.838257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1180/2399] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:32.844387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.866838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344193a-1d75-4164-b46c-2d813954ba7b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.877117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.878416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.878930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.879500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:32.881038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:32.885311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:32.939610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1181/2400] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:32.945354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:32.980382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d8ca-ef21-4d49-bc74-d6957497563e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:32.993033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:32.994489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:32.995766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:32.996501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] PATH_INFO: `/v3/projects/0fd4a86a7e814d5b939d62859d962ee3/users/9c75a3dfea904720968352ee24eabb4e/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:33.042025 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd4a86a7e814d5b939d62859d962ee3, user_id=9c75a3dfea904720968352ee24eabb4e, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:33.053361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa13747-f6c6-49f1-a0a1-7f92cc4502c7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:33.073636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b10190661e4bb0a75a9e1726a41d6a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:33.502489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1182/2401] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:32 2022] PUT /identity/v3/projects/0fd4a86a7e814d5b939d62859d962ee3/users/9c75a3dfea904720968352ee24eabb4e/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:33.515188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:33.515479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:33.516240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:33.561542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] MFA Rules not processed for user `9c75a3dfea904720968352ee24eabb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:33.563219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:33.576194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b10190661e4bb0a75a9e1726a41d6a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:33.576194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b10190661e4bb0a75a9e1726a41d6a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:33.599775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b10190661e4bb0a75a9e1726a41d6a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:33.624580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6598a4c3-ee1a-4811-bef3-1bf0fff68cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b10190661e4bb0a75a9e1726a41d6a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:33.632897 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1220/2402] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:32 2022] DELETE /identity/v3/users/a0b10190661e4bb0a75a9e1726a41d6a => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:33.639230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:33.639782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:33.640233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:33.686020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:33.689078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:33.730304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1183/2403] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:33.732283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:33.740054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:33.826645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1221/2404] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:33.827361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:33.829102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:33.893892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168158c-1921-4d09-9502-7a71ac121689 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:33.905505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:33.908974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:33.909719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:33.911785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:33.912807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] PATH_INFO: `/v3/projects/b59cdb51491b40fe8dac57999cf29142` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:33.914475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59cdb51491b40fe8dac57999cf29142)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:33.917291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:33.947469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1818-729f-456e-a26e-66d9b68518fd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:33.956728 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:33.960452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:33.960452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:33.960452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:34.062668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:34.064176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:34.066293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59cdb51491b40fe8dac57999cf29142', 'request_id': 'req-7ae64a74-224a-4027-bf4d-0eac1fb31642'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:34.083144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1222/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:34.083848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:34.085543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:34.204783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647c98f-64f0-4937-945e-523fe497c1b2 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:34.291998 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59cdb51491b40fe8dac57999cf29142', 'request_id': 'req-7ae64a74-224a-4027-bf4d-0eac1fb31642'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:34.301597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59cdb51491b40fe8dac57999cf29142', 'request_id': 'req-7ae64a74-224a-4027-bf4d-0eac1fb31642'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:34.332735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] The token cache is being invalidate because project b59cdb51491b40fe8dac57999cf29142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:34.333040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:34.335250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:34.337041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1184/2406] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:33 2022] DELETE /identity/v3/projects/b59cdb51491b40fe8dac57999cf29142 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:34.341895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:34.345674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:34.363918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:34.364851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:34.365142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:34.365478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:34.370593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:34.418890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:34.534448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae64a74-224a-4027-bf4d-0eac1fb31642 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:34.554401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:34.555086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:34.555465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:34.555744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] PATH_INFO: `/v3/users/ba5425e985034a16812d6830d2889436` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:34.556257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:34.560876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b4f79-0a55-4d3d-a823-3c8eb0095466 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:34.565267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5425e985034a16812d6830d2889436)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:34.567373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:34.594952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1223/2407] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:34.882490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:34.882490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:34.882490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:34.942095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] MFA Rules not processed for user `711396a88956426c9eb554f518230a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:34.943665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:34.981126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5425e985034a16812d6830d2889436'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:35.062592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1224/2408] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:35.067219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.070010 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:35.102833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc16ec-e032-46be-b192-5d0a6822eecd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.119061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5425e985034a16812d6830d2889436'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:35.120191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5425e985034a16812d6830d2889436'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:35.125822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.130344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.135223 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5425e985034a16812d6830d2889436'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:35.137736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.138477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.140023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.143651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:35.181643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5425e985034a16812d6830d2889436'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:35.191330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1185/2409] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:34 2022] DELETE /identity/v3/users/ba5425e985034a16812d6830d2889436 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:35.298254 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1225/2410] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:35 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:35.298950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.301023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:35.428857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af132a-3e3b-4dcd-914b-8cc4f961afbd admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.582282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.584819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:35.604871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.606172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.611228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.611228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.611722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.614708 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:35.691862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:35.766493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c7462-305b-4f72-a451-4c023a040983 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.776679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.779227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.780069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.780831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] PATH_INFO: `/v3/projects/0f873325b355496a953a90409cbff58f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.783944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f873325b355496a953a90409cbff58f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.788313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:35.795483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1186/2411] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:35 2022] POST /identity/v3/users => generated 293 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:35.799467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.823218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4f9f-b26e-44bc-ab15-b3aa38a94f99 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.838603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.839504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.839973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.841148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.842341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.844239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:35.868561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1187/2412] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:35.878362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.898135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a663-a247-4ea1-b981-f55a44fbbe02 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.909587 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.910629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.911121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.912011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] PATH_INFO: `/v3/projects/82322ca9fc00485aafb194157bb1985d/users/31265c8659b34073846d77e80d7fedc1/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.948601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82322ca9fc00485aafb194157bb1985d, user_id=31265c8659b34073846d77e80d7fedc1, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.954835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.149589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1188/2413] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:35 2022] PUT /identity/v3/projects/82322ca9fc00485aafb194157bb1985d/users/31265c8659b34073846d77e80d7fedc1/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:36.149589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:36.153926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:36.160331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f873325b355496a953a90409cbff58f', 'request_id': 'req-cb0bf743-3cae-4a3c-8396-a489adfdab98'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.259601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52910-c5c5-49a6-960b-f64a0f925851 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:36.359959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:36.361178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.361697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.362234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] PATH_INFO: `/v3/projects/20b7cfdef0ae4088bd72b85509bb02b3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.364190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b7cfdef0ae4088bd72b85509bb02b3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:36.368142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.442567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f873325b355496a953a90409cbff58f', 'request_id': 'req-cb0bf743-3cae-4a3c-8396-a489adfdab98'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.451132 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f873325b355496a953a90409cbff58f', 'request_id': 'req-cb0bf743-3cae-4a3c-8396-a489adfdab98'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.471069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] The token cache is being invalidate because project 0f873325b355496a953a90409cbff58f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:36.475761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.477289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.480178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1226/2414] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:35 2022] DELETE /identity/v3/projects/0f873325b355496a953a90409cbff58f => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:36.499009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:36.501893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:36.537398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bf743-3cae-4a3c-8396-a489adfdab98 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:36.577137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:36.578672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.579393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.579940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.588461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:36.591762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.630351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:36.630351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b7cfdef0ae4088bd72b85509bb02b3', 'request_id': 'req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.671709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1227/2415] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:36.676259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:36.729004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d0f9-5660-4359-95e5-600c5c6ace51 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:36.815480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b7cfdef0ae4088bd72b85509bb02b3', 'request_id': 'req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.827082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b7cfdef0ae4088bd72b85509bb02b3', 'request_id': 'req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.849124 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] The token cache is being invalidate because project 20b7cfdef0ae4088bd72b85509bb02b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:36.849436 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.850304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.853602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1189/2416] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:36 2022] DELETE /identity/v3/projects/20b7cfdef0ae4088bd72b85509bb02b3 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:36.865683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:36.869016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:36.874977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:36.876838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.876838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.877138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] PATH_INFO: `/v3/projects/82322ca9fc00485aafb194157bb1985d/users/31265c8659b34073846d77e80d7fedc1/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.880621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82322ca9fc00485aafb194157bb1985d, user_id=31265c8659b34073846d77e80d7fedc1, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:36.884128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3e5c0-7247-4c60-8984-f7b183a9f8cc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:36.885298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.890706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:36.891479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.891692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.891999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] PATH_INFO: `/v3/users/f059d77034394ddbbca013ccc4e558cf` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.894781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f059d77034394ddbbca013ccc4e558cf)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:36.895381 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.904929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1228/2417] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:36 2022] PUT /identity/v3/projects/82322ca9fc00485aafb194157bb1985d/users/31265c8659b34073846d77e80d7fedc1/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:37.203286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f059d77034394ddbbca013ccc4e558cf'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:37.323660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f059d77034394ddbbca013ccc4e558cf'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:37.324495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f059d77034394ddbbca013ccc4e558cf'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:37.334797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f059d77034394ddbbca013ccc4e558cf'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:37.360555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0b615d36-add0-47a3-a051-88c76e549d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f059d77034394ddbbca013ccc4e558cf'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:37.376203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1190/2418] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:36 2022] DELETE /identity/v3/users/f059d77034394ddbbca013ccc4e558cf => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:38.158700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.161227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:38.351586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed842-3f67-4cff-b097-a577851599c8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.450807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.451502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.451788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.452077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] PATH_INFO: `/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.453495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8e51006065429bb6e5c6c9f1f230ff)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.455487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.498748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.631271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8e51006065429bb6e5c6c9f1f230ff', 'request_id': 'req-9745ace8-9031-4200-bf28-616f2a5d6004'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.827709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8e51006065429bb6e5c6c9f1f230ff', 'request_id': 'req-9745ace8-9031-4200-bf28-616f2a5d6004'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.842429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8e51006065429bb6e5c6c9f1f230ff', 'request_id': 'req-9745ace8-9031-4200-bf28-616f2a5d6004'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.868404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] The token cache is being invalidate because project 9e8e51006065429bb6e5c6c9f1f230ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:38.869106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.870193 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9745ace8-9031-4200-bf28-616f2a5d6004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.873048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1229/2419] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:38 2022] DELETE /identity/v3/projects/9e8e51006065429bb6e5c6c9f1f230ff => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:38.880849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.881678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.881678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.917466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:38.920184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:39.018854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1191/2420] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:39.030135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:39.031061 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:39.031772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:39.069431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:39.071025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:39.094963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1230/2421] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:39.100709 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:39.138729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fb087-7923-42ca-8a12-b2641512b103 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:39.171544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:39.172890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:39.173393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:39.173855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:39.174967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:39.175291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:39.177324 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:39.212085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1192/2422] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:39.212906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:39.255151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f1bd4-08c3-4adc-85b3-cb62806af0e2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:39.279440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:39.279440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:39.279440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:39.279440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:39.280029 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:39.291895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:39.695573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:39.728971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1231/2423] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:39 2022] POST /identity/v3/projects => generated 385 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:39.741122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366acfa-86e7-40f5-aec3-a7f8edf5daa9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:39.892892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:39.894439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:39.894904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:39.895387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:39.896254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:39.898406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:40.420923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1193/2424] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:39 2022] POST /identity/v3/users => generated 293 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:40.425818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:40.443330 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18149da2-800e-4a7d-9821-bef0fcefdaa3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:40.451053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:40.451970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.452427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.452901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.453579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:40.455240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:40.471591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1232/2425] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:40.476406 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:40.496205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ff33-9b0d-4029-a513-d529c01c9078 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:40.499661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:40.500552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.501825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.501825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.502505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:40.504400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65877467-e856-4db0-afe8-22b802ea21b3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:40.518378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1194/2426] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:40.523445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:40.535935 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86b122-b7b3-4c44-b481-2089dbd67f70 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:40.541143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:40.541847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.542130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.542410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] PATH_INFO: `/v3/projects/4b40647916264185b109f513bb26e20f/users/ad55539dfb8944a5b61cd42d89854e0c/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.563085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b40647916264185b109f513bb26e20f, user_id=ad55539dfb8944a5b61cd42d89854e0c, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:40.565930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:40.664962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1233/2427] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:40 2022] PUT /identity/v3/projects/4b40647916264185b109f513bb26e20f/users/ad55539dfb8944a5b61cd42d89854e0c/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:40.686014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.687017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.687928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.760734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] MFA Rules not processed for user `ad55539dfb8944a5b61cd42d89854e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:40.764943 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:40.921276 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1195/2428] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:40.938977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:40.943182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:41.147185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e43e6-84b3-4520-beea-66a6d7884f88 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:41.154034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:41.155128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:41.155630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:41.156198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:41.174492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:41.177717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfef6f-9fe8-40a3-a6fd-97ec457ef52b service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:41.200812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1234/2429] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:41.244578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:41.436731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894543e7-dd92-4e66-bfc7-0febd372a29b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:41.460277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:41.462050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:41.463869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:41.466515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] PATH_INFO: `/v3/users/ad55539dfb8944a5b61cd42d89854e0c` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:41.471492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad55539dfb8944a5b61cd42d89854e0c)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:41.476756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:41.581625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:41.764187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad55539dfb8944a5b61cd42d89854e0c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:41.884341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad55539dfb8944a5b61cd42d89854e0c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:41.885196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad55539dfb8944a5b61cd42d89854e0c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:41.894892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad55539dfb8944a5b61cd42d89854e0c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:41.911347 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad55539dfb8944a5b61cd42d89854e0c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:41.919176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1196/2430] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:41 2022] DELETE /identity/v3/users/ad55539dfb8944a5b61cd42d89854e0c => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:41.924562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:41.925329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:41.925329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:41.959703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:41.965565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:42.091124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1235/2431] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:42.115388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:42.117914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:42.267921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21c114-d087-483b-8e74-831ee59a9f0d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:42.285166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:42.285166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:42.285166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:42.285166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:42.331537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:42.333451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecad3e-ebd1-4cd0-bb72-88cdd34ae4e4 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:42.359435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1197/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:43.145199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:43.842925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:43.844939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:43.874887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e709bf4-844e-4703-90c8-2c67b898fcbb None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:43.882923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:43.885485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:43.886108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:43.887524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] PATH_INFO: `/v3/projects/4b40647916264185b109f513bb26e20f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:43.890130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b40647916264185b109f513bb26e20f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:43.893192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:44.081264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b40647916264185b109f513bb26e20f', 'request_id': 'req-147a0e41-02d1-4965-a297-c90f2102645b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:44.227565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b40647916264185b109f513bb26e20f', 'request_id': 'req-147a0e41-02d1-4965-a297-c90f2102645b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:44.253900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b40647916264185b109f513bb26e20f', 'request_id': 'req-147a0e41-02d1-4965-a297-c90f2102645b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:44.273485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] The token cache is being invalidate because project 4b40647916264185b109f513bb26e20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:44.274311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:44.275326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-147a0e41-02d1-4965-a297-c90f2102645b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:44.279131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1236/2433] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:43 2022] DELETE /identity/v3/projects/4b40647916264185b109f513bb26e20f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:44.286126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:44.287082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:44.287850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:44.326442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:44.327822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:44.439660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1198/2434] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:44.456690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:44.457479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:44.458948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:44.545236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:44.546727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:44.577028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1237/2435] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:44.586681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:44.611354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:44.621880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bed9e-5afc-4e70-a9db-1edb8aea7e38 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:44.631369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:44.632714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:44.633315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:44.634106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:44.635554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:44.636540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:44.640172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:44.666000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1199/2436] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:44.671836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:44.682847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b083e3-b06c-472e-96ea-683271d212bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:44.692383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:44.692383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:44.692383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:44.692383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:44.693190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:44.693190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:44.822852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1238/2437] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:44 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:44.828972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:44.847990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c045be-6e18-4145-9c3b-8a422c400648 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:44.891762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:44.977110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:44.978700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:44.979549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:44.980928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:44.982524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:44.986567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:45.131922 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:45.133142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1200/2438] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:44 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:45.154205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9df2b-9589-463a-a960-bf8775af05ce admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:45.174589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:45.176142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:45.176853 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:45.177475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:45.178844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:45.182851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:45.224723 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1239/2439] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:45.231351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:45.251967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7013-7b52-4d81-a2d3-cfb4955e8d06 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:45.265050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:45.266699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:45.267119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:45.268800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:45.269714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:45.278921 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24e64a-a028-4a41-b0b6-6d94d8b3b39d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:45.310430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1201/2440] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:45.317182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:45.332240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0219cb-87f4-413b-9066-af10e3519940 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:45.339332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:45.340731 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:45.341270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:45.341794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] PATH_INFO: `/v3/projects/ca48610ceeef4976ae3b61a8933cf4d7/users/0637e8c0f07d496dada40ee29729196a/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:45.370581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca48610ceeef4976ae3b61a8933cf4d7, user_id=0637e8c0f07d496dada40ee29729196a, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:45.378812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:45.576474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1240/2441] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:45 2022] PUT /identity/v3/projects/ca48610ceeef4976ae3b61a8933cf4d7/users/0637e8c0f07d496dada40ee29729196a/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:45.600178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67bba5-fd53-45fb-bb37-f929ed20b2fc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:45.600469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67bba5-fd53-45fb-bb37-f929ed20b2fc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:45.600772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67bba5-fd53-45fb-bb37-f929ed20b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:45.649837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3a67bba5-fd53-45fb-bb37-f929ed20b2fc None None] MFA Rules not processed for user `0637e8c0f07d496dada40ee29729196a`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:45.650909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3a67bba5-fd53-45fb-bb37-f929ed20b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:45.770773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1202/2442] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:45.791378 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:45.805373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:46.005961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5865be-f24a-4603-97ff-6811eb5c4259 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:46.017191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:46.023222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:46.023919 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:46.024619 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:46.046005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:46.063644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:46.097345 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1241/2443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:46.205253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:46.926178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:48.081971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a7ac-0868-4881-8e04-ea8b713a8975 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:48.083125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a7ac-0868-4881-8e04-ea8b713a8975 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:48.083410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a7ac-0868-4881-8e04-ea8b713a8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:48.120233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8419a7ac-0868-4881-8e04-ea8b713a8975 None None] MFA Rules not processed for user `31265c8659b34073846d77e80d7fedc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:48.122208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8419a7ac-0868-4881-8e04-ea8b713a8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:48.214778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1203/2444] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:48.234117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:48.236281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:48.347429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe6fa-8b2a-4224-a0aa-30dccc61bc41 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:48.356505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:48.357353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:48.357640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:48.357916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:48.360560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:48.448818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:48.451293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:48.461766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1242/2445] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:50.685794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:51.276295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:52.211565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb88fa-fe21-42e4-9659-92da25e9f26c None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:52.212040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb88fa-fe21-42e4-9659-92da25e9f26c None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:52.212325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb88fa-fe21-42e4-9659-92da25e9f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:52.234516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-38fb88fa-fe21-42e4-9659-92da25e9f26c None None] MFA Rules not processed for user `711396a88956426c9eb554f518230a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:52.235875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-38fb88fa-fe21-42e4-9659-92da25e9f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:52.243047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1204/2446] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:52.491467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:52.581323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f7311-8311-4d49-a96f-ad605321f744 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:52.588924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:52.590355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:52.590778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:52.591077 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] PATH_INFO: `/v3/users/0637e8c0f07d496dada40ee29729196a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:52.592427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0637e8c0f07d496dada40ee29729196a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:52.594875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:52.902582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0637e8c0f07d496dada40ee29729196a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:53.045112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0637e8c0f07d496dada40ee29729196a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:53.046846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0637e8c0f07d496dada40ee29729196a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:53.071699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0637e8c0f07d496dada40ee29729196a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:53.087448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0637e8c0f07d496dada40ee29729196a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:53.105746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1243/2447] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:52 2022] DELETE /identity/v3/users/0637e8c0f07d496dada40ee29729196a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:53.106185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:53.106822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:53.107076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:53.143903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:53.145542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:53.257455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1205/2448] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:53.265769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:53.267274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:53.339702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a771d0-c048-4e97-b573-62fbf24791b2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:53.344070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:53.344743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:53.345031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:53.345301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:53.356228 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:53.358207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4de9c2-df9f-4911-a240-4e3f819bee21 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:53.369524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1244/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:53.933141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:53.935360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:53.957936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada67e3-fe1b-4577-a4e2-8fe468ae7f3b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:53.968931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:53.970091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:53.970573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:53.971062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] PATH_INFO: `/v3/projects/ca48610ceeef4976ae3b61a8933cf4d7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:53.973968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca48610ceeef4976ae3b61a8933cf4d7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:53.977955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:54.229685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca48610ceeef4976ae3b61a8933cf4d7', 'request_id': 'req-f8452e4a-3f40-4fd6-8d87-943c31128803'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:54.283391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:54.325861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca48610ceeef4976ae3b61a8933cf4d7', 'request_id': 'req-f8452e4a-3f40-4fd6-8d87-943c31128803'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:54.334882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca48610ceeef4976ae3b61a8933cf4d7', 'request_id': 'req-f8452e4a-3f40-4fd6-8d87-943c31128803'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:54.353907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] The token cache is being invalidate because project ca48610ceeef4976ae3b61a8933cf4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:54.354246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:54.354940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f8452e4a-3f40-4fd6-8d87-943c31128803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:54.356905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1206/2450] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:53 2022] DELETE /identity/v3/projects/ca48610ceeef4976ae3b61a8933cf4d7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:54.363532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:54.364718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:54.364718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:54.392624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:54.394678 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:54.477382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1245/2451] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:54.487050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:54.487341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:54.487624 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:54.520059 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:54.523336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:54.528700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:54.542814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1207/2452] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:54.548596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:54.560211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732a98-002c-4304-9ca9-8ac850a920c0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:54.565718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:54.566384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:54.569616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:54.569616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:54.569616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:54.569616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:54.570082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:54.585771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1246/2453] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:12:54.591148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:54.601928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eeade-c422-4f93-abd3-85c3125e07e4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:54.608627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:54.608627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:54.608627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:54.608627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:54.609232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:54.611407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:54.814547 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1208/2454] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:54 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:54.831223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:54.847795 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5e7d-7a21-4883-be95-5d317c96dac5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:54.950129 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:54.950509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:54.950824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:54.951141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:54.951868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:54.954108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:55.142783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1247/2455] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:54 2022] POST /identity/v3/users => generated 288 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:55.150167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:55.166020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af113f93-2605-43dd-b470-3475cd11d34c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:55.172690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:55.177572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:55.177572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:55.177572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:55.177572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:55.177572 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:55.197937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1209/2456] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:55.204660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:55.218250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4314be-5faa-4f3a-993d-9389b13fd6b7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:55.224999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:55.225650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:55.225994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:55.226280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:55.226949 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:55.228914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b132bd6-f8c6-4ac9-9260-a34f5b4b07f4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:55.243792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1248/2457] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:55.249594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:55.264250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce1ed-384c-4ce0-a630-87242181858a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:55.270704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:55.271594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:55.272031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:55.272464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] PATH_INFO: `/v3/projects/217feab4d42c4581967f8b8b0f038cbf/users/f3a86f3c479847cab52af6931f0f09e6/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:55.297167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217feab4d42c4581967f8b8b0f038cbf, user_id=f3a86f3c479847cab52af6931f0f09e6, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:55.301455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:55.479597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1210/2458] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:55 2022] PUT /identity/v3/projects/217feab4d42c4581967f8b8b0f038cbf/users/f3a86f3c479847cab52af6931f0f09e6/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:55.554307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cffa-8970-4704-b390-a25707bc4b4a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:55.555146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cffa-8970-4704-b390-a25707bc4b4a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:55.555146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cffa-8970-4704-b390-a25707bc4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:55.594468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6fc6cffa-8970-4704-b390-a25707bc4b4a None None] MFA Rules not processed for user `f3a86f3c479847cab52af6931f0f09e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:55.595800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6fc6cffa-8970-4704-b390-a25707bc4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:55.700886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1249/2459] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:55.713449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:55.716446 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:55.802845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169cb6-1f42-4364-99c7-d737bd8e3052 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:55.809674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:55.810988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:55.811491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:55.811936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:55.831431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:55.833232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:55.846420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1211/2460] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:55.928155 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:56.518516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:58.300891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:58.701423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:59.100097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:59.103958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:59.103958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:59.128044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] MFA Rules not processed for user `f3a86f3c479847cab52af6931f0f09e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:59.129528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:59.138275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1250/2461] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:59.786246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:00.460458 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:01.165231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:02.518061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:03.062105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:03.875747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:03.877263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:03.974062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a346f-4b86-48d8-a089-46e6b130e945 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:03.977533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:03.978595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:03.978963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:03.979249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:03.982802 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:04.008173 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:04.012393 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017225d-3314-48fc-b107-e9df796de98c service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:04.031796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1212/2462] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:05.807979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:05.811023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:05.954133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27a27c-48b7-4731-b42e-33303e77803a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:05.967026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:05.967026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:05.967026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:05.967026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] PATH_INFO: `/v3/users/9c75a3dfea904720968352ee24eabb4e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:05.969301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c75a3dfea904720968352ee24eabb4e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:05.977652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:06.168320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:06.449769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c75a3dfea904720968352ee24eabb4e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:06.581208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c75a3dfea904720968352ee24eabb4e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:06.591960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:06.591960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c75a3dfea904720968352ee24eabb4e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:06.693803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c75a3dfea904720968352ee24eabb4e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:06.718081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c75a3dfea904720968352ee24eabb4e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:06.733623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1251/2463] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:05 2022] DELETE /identity/v3/users/9c75a3dfea904720968352ee24eabb4e => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:13:06.740238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:06.744684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:06.746355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:06.820659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:06.829808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:07.179520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1213/2464] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:07.193488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:07.195403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:07.660044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef75f6-0f04-474a-8ab4-6e2b982eac37 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:07.668027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:07.669218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:07.669755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:07.670040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:07.685552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:07.687410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b1307-6748-4b7b-a596-f55fdb9fda1d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:07.703335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1252/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:08.637415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:08.640023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:08.684350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcd4aa-d84f-4342-b6a1-d972ec18d6c3 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:08.709088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:08.710139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:08.710640 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:08.711299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] PATH_INFO: `/v3/projects/0fd4a86a7e814d5b939d62859d962ee3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:08.713385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd4a86a7e814d5b939d62859d962ee3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:08.717134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:08.767615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:08.872600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd4a86a7e814d5b939d62859d962ee3', 'request_id': 'req-1b0893ed-97b5-4462-8ae3-f36641c5d714'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:08.974022 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd4a86a7e814d5b939d62859d962ee3', 'request_id': 'req-1b0893ed-97b5-4462-8ae3-f36641c5d714'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:08.983737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd4a86a7e814d5b939d62859d962ee3', 'request_id': 'req-1b0893ed-97b5-4462-8ae3-f36641c5d714'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:09.006303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] The token cache is being invalidate because project 0fd4a86a7e814d5b939d62859d962ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:09.011871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:09.011871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1b0893ed-97b5-4462-8ae3-f36641c5d714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:09.011871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1214/2466] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:08 2022] DELETE /identity/v3/projects/0fd4a86a7e814d5b939d62859d962ee3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:09.013957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:11.177376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:11.913178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:12.617884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:15.643327 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:16.060586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:19.445268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:19.663224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:23.787071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:23.963991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:26.746554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:27.676582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:27.678092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:27.678559 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:27.706896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] MFA Rules not processed for user `dcb0911fad8c4d20ab2e832afd6bc51f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:27.709111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:27.815987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:27.827505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1253/2467] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:13:29.553474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f378-3670-441f-a8b3-c1056f3d69bb None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.553474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f378-3670-441f-a8b3-c1056f3d69bb None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.553474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f378-3670-441f-a8b3-c1056f3d69bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.576186 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ae07f378-3670-441f-a8b3-c1056f3d69bb None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:29.577457 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ae07f378-3670-441f-a8b3-c1056f3d69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:29.653559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1215/2468] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:29.702699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:29.704777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:29.789483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128db8-87c4-470e-b262-33c1c8a13259 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.795154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.795722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.796006 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.796282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.805824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.807393 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.818870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1254/2469] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:30.580340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.210144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.322702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770b25-3f9f-4220-a014-3505a4776671 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:31.323182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770b25-3f9f-4220-a014-3505a4776671 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:31.324200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770b25-3f9f-4220-a014-3505a4776671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:31.361362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ee770b25-3f9f-4220-a014-3505a4776671 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:31.362881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee770b25-3f9f-4220-a014-3505a4776671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:31.381043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1216/2470] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:31.410469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:31.434831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c59d-7240-4ae5-88d2-8f0b8144bc35 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:31.447545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:31.449343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:31.449820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:31.450273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:31.468111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:31.471515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:31.490056 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1255/2471] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:32.486651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:32.598714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d432-8a82-4d36-82c1-f77ac8478596 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:32.599590 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d432-8a82-4d36-82c1-f77ac8478596 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:32.600315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8d432-8a82-4d36-82c1-f77ac8478596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:32.646564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b7e8d432-8a82-4d36-82c1-f77ac8478596 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:32.648021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b7e8d432-8a82-4d36-82c1-f77ac8478596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:32.658972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1217/2472] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:32.689668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:32.705901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9eb55-a088-4011-a063-6d3f02d0425f service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:32.716136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:32.717484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:32.718092 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:32.718708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:32.734439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:32.738822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:32.756317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1256/2473] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:33.569522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:33.828282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:33.829593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:33.830057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:33.856224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:33.858500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:33.904299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1218/2474] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:33.945522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:33.957617 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b271e47-8ee2-4024-85e1-b92fd0f29600 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:33.979320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:33.981160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:33.981630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:33.981908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:34.007708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:34.012694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:34.035979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:34.046140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1257/2475] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:13:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:13:35.307370 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:35.642318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:35.894518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:37.192280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:37.194441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:37.281712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32cc56-41f2-4965-a5f3-e9e7fca13921 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:37.286373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:37.288192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:37.288444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:37.293279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:37.293279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:37.402875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:37.405318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63b2b6-e1f4-4b59-ab21-b948d450079c service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:37.416582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1219/2476] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:37.571130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:37.572977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:37.653218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5781f9-9240-4b26-a36f-889b20c62f98 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:37.658499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:37.659196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:37.659541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:37.659726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] PATH_INFO: `/v3/users/f3a86f3c479847cab52af6931f0f09e6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:37.660987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a86f3c479847cab52af6931f0f09e6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:37.663054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:38.061302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a86f3c479847cab52af6931f0f09e6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:38.164368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e09a-5eed-48b5-bc67-47321dbe90f9 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:38.165023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e09a-5eed-48b5-bc67-47321dbe90f9 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:38.165414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e09a-5eed-48b5-bc67-47321dbe90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:38.175085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:38.190285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fe06e09a-5eed-48b5-bc67-47321dbe90f9 None None] MFA Rules not processed for user `4e2982e7cf254d408ebadaa62555b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:38.191769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fe06e09a-5eed-48b5-bc67-47321dbe90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:38.233598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a86f3c479847cab52af6931f0f09e6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:38.235818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a86f3c479847cab52af6931f0f09e6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:38.277366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a86f3c479847cab52af6931f0f09e6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:38.299407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a86f3c479847cab52af6931f0f09e6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:38.314309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1220/2477] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:38.322475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1258/2478] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:37 2022] DELETE /identity/v3/users/f3a86f3c479847cab52af6931f0f09e6 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:38.331115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:38.332346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:38.332346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:38.391627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:38.394198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:38.580966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1221/2479] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:38.605366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:38.608423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:38.684576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794941-571f-46ec-a40f-d12be23aa1e8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:38.690446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:38.691895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:38.692554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:38.693031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:38.704816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:38.706281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:38.720134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1259/2480] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:38.894661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:39.313170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:39.316412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:39.358643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c4112-017f-41fc-8d37-abeee8741057 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:39.367827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:39.369721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:39.370182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:39.370909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] PATH_INFO: `/v3/projects/217feab4d42c4581967f8b8b0f038cbf` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:39.373890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217feab4d42c4581967f8b8b0f038cbf)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:39.376704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:39.554901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217feab4d42c4581967f8b8b0f038cbf', 'request_id': 'req-4144a4db-1cea-4c74-8b5f-1c37beff8b64'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:39.687646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217feab4d42c4581967f8b8b0f038cbf', 'request_id': 'req-4144a4db-1cea-4c74-8b5f-1c37beff8b64'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:39.699219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217feab4d42c4581967f8b8b0f038cbf', 'request_id': 'req-4144a4db-1cea-4c74-8b5f-1c37beff8b64'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:39.718194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] The token cache is being invalidate because project 217feab4d42c4581967f8b8b0f038cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:39.718488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:39.719171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:39.720761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1222/2481] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:39 2022] DELETE /identity/v3/projects/217feab4d42c4581967f8b8b0f038cbf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:42.031900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:42.514225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:43.596829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:45.254711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:45.505805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:48.070795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:48.288342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:49.002062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:49.396819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:50.288714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:50.757879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:50.836041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:51.307291 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:51.970346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:52.350787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:52.996641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:53.323309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:53.619846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:53.728208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:54.259492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:54.545113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:55.041385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:55.248037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:55.608152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:56.202439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:56.311029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:56.738844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.037032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.134690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.265512 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.345216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.476856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.505307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.733708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.774258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.924317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.008659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.037112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.197757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.236415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.425871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.471185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.598456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.722611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.870529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.991071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.106793 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.236756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.282428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.396330 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.505925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.631479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.659866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.796966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:59.831335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.071134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.134041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.425532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.539749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.985372 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.076655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.105798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.625377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.693971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.838037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:01.991889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.151296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.294375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.392094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.522283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.609050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.699950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.827518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:02.929651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:12.670015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:12.998691 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:33.980864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:33.991194 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1a3b-dcf6-439f-9dd0-5c1051da9ae0 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:34.069779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:34.070498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:34.070855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:34.071587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:34.075567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:34.204033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:34.205694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:34.218712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1260/2482] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:35.399533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:35.402094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:35.416698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a4db-1cea-4c74-8b5f-1c37beff8b64 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:35.422153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:35.422878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:35.423161 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:35.423441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:35.425586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:35.442269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:35.444021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:35.458816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1223/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:44.212903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=54 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:45.453570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=6 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:47.186348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:47.186348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:47.216404 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d302f8-f95a-447a-8895-178d0050ac39 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:47.223094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:47.223670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:47.224015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:47.224296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:47.226425 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:47.302984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:47.304628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee8af0-3fb4-40f9-821b-8fd6967f131f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:47.315623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1261/2484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:50.183086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:50.201359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:50.201359 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc22e-9e52-441a-8825-88315a2dec5b service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:50.207008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:50.207726 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:50.208231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:50.208534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:50.210686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:50.288190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:50.290548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:50.307306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1224/2485] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:14:52.826347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:52.826977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:52.826977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:52.854694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] MFA Rules not processed for user `dcb0911fad8c4d20ab2e832afd6bc51f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:52.856000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:52.865176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1262/2486] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:14:53.445297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:53.461929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819031fe-e367-4b74-ad16-b8b40e6ae318 service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:53.469287 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:53.470335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:53.470828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:53.471304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:53.474804 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:53.494053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:53.496926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:53.510574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1225/2487] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:56.729058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:56.731144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:56.747834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3032-ed58-469f-bba4-83c85bf9a374 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:56.753850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:56.755024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:56.755553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:56.755921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:56.758618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:56.884296 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:56.886149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:56.902031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1263/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:15:03.504780 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=34 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:03.622072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:03.637231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f5fad-c85d-4c60-b0e0-1c289a45d2b7 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:03.642988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:03.643799 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:03.644235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:03.646177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:03.648483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:03.660807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:03.662304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:03.673043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1226/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:03.934941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:03.936663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:04.039032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325adb11-b96b-48cb-a4f4-b3c8762f59d3 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:04.045988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:04.046736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:04.047015 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:04.047289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:04.049308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:04.062815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:04.064466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003f36c-d7d2-4e5b-85ab-f552ee798a04 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:04.077207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1264/2490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:04.185868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:04.188152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:04.209469 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b55ce-04e8-4e7c-a8bd-29761dce34d1 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:04.214571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:04.215246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:04.215531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:04.215815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] PATH_INFO: `/v3/users/4e2982e7cf254d408ebadaa62555b0dd` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:04.217176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2982e7cf254d408ebadaa62555b0dd)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:04.219388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:04.500966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2982e7cf254d408ebadaa62555b0dd'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:04.606926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2982e7cf254d408ebadaa62555b0dd'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:04.614323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2982e7cf254d408ebadaa62555b0dd'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:04.618045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2982e7cf254d408ebadaa62555b0dd'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:04.634573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2982e7cf254d408ebadaa62555b0dd'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:04.644689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1227/2491] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:15:04 2022] DELETE /identity/v3/users/4e2982e7cf254d408ebadaa62555b0dd => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:04.659866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6977-4643-4101-8a41-dfc27498e38e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:04.660323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6977-4643-4101-8a41-dfc27498e38e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:04.660911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb6977-4643-4101-8a41-dfc27498e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:04.689714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f8fb6977-4643-4101-8a41-dfc27498e38e None None] MFA Rules not processed for user `f1421549f2c34db8a75176ecef573353`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:04.691463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f8fb6977-4643-4101-8a41-dfc27498e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:04.706558 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:04.778304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1265/2492] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:05.034526 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:05.037562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:05.140373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc601a-ac89-4226-9536-765b6ba38ddb admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:05.148562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:05.149315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.149626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.149910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] PATH_INFO: `/v3/projects/3f50a27a77a948368ac15d4e018b39e7` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.151939 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f50a27a77a948368ac15d4e018b39e7)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:05.154781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:05.265855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f50a27a77a948368ac15d4e018b39e7', 'request_id': 'req-58912ee0-8ef9-4454-8616-da1a26177062'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:05.384465 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f50a27a77a948368ac15d4e018b39e7', 'request_id': 'req-58912ee0-8ef9-4454-8616-da1a26177062'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:05.391220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:05.397576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f50a27a77a948368ac15d4e018b39e7', 'request_id': 'req-58912ee0-8ef9-4454-8616-da1a26177062'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:05.408591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] The token cache is being invalidate because project 3f50a27a77a948368ac15d4e018b39e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:15:05.408907 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:05.409614 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-58912ee0-8ef9-4454-8616-da1a26177062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:05.411562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1228/2493] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:15:05 2022] DELETE /identity/v3/projects/3f50a27a77a948368ac15d4e018b39e7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:05.417932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.418509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.418842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.443281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:05.444780 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:05.531461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1266/2494] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:05.539502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.539896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.540175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.563117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:05.564357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:05.574179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1229/2495] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:05.578812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:05.590665 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c04a-bd64-4c66-885d-47af23f3c3af None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:05.596286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:05.597051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.597314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.597587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.598377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:15:05.598580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:05.601282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:05.617739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1267/2496] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:15:05.625881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:05.642758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07349c22-da24-4212-9e9c-dc861cba28c2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:05.651724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:05.652741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.653398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.653834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.655335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:05.660192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:05.709159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:05.712554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:05.825967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1230/2497] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:15:05 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:15:05.833463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:05.850108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17b70a-85ec-4809-82e6-692cd3ce676f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:05.946418 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:05.964960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799f92-00a5-40f5-b46a-cd73fdda4e9d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:05.969456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:05.970121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.970557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.970882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.973088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:05.974489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:05.975258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:05.975790 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:05.976258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:05.977487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:05.980313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:05.987649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:05.989995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:06.002518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1268/2498] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:06.088923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1231/2499] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:15:05 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:15:06.094616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:06.108016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9847b2-c4c4-4d90-b4ac-f0f2d4105b3a service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:06.112333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:06.113004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:06.113286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:06.113561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:06.114212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:06.115986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:06.131893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1269/2500] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:06.133983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:06.152904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ef74-c95d-4ee0-ba0d-616c8a2bc2cc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:06.158858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:06.159496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:06.159789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:06.160232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:06.160969 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:06.162637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ad640-b653-437c-b22b-1670e6f87398 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:06.180560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1232/2501] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:06.185885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:06.200983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7eb1-757c-4c72-9f18-dda47f89cb3e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:06.209152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:06.210386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:06.221396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:06.221396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] PATH_INFO: `/v3/projects/ec48c3a2711f421b84c275c9591c7ce6/users/544278669a2d4884bcfc7c2f7dbff624/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:06.241498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec48c3a2711f421b84c275c9591c7ce6, user_id=544278669a2d4884bcfc7c2f7dbff624, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:06.247163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:06.346120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1270/2502] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:15:06 2022] PUT /identity/v3/projects/ec48c3a2711f421b84c275c9591c7ce6/users/544278669a2d4884bcfc7c2f7dbff624/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:06.352858 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:06.353262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:06.353618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:06.376258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:06.377549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:06.445621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1233/2503] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:06.464499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:06.467511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:06.574825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36196ce-a24a-4369-bf44-743a82af92f8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:06.578946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:06.579590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:06.579875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:06.580158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:06.597087 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:06.601766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:06.624644 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1271/2504] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:13.613345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:13.619539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:13.736698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:13.824271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8a64-e303-4a46-aaa6-a038828b313b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:13.843068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:13.844360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:13.844888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:13.845915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:13.850391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:13.889601 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:13.894242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabecc6-95fd-4f19-b475-4cdc7478219c service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:13.921767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1234/2505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:14.903592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:14.934777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab02db6-89c2-4dc4-9ee6-eceb83547c1c service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:14.946199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:14.948066 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:14.954473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:14.954473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:14.954473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:14.974541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:14.976929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:14.998459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1272/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:15:17.891106 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef9df-f683-42a5-b652-8eb159ae8fb8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:17.891997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef9df-f683-42a5-b652-8eb159ae8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:17.891997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef9df-f683-42a5-b652-8eb159ae8fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:17.926649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1d6ef9df-f683-42a5-b652-8eb159ae8fb8 None None] MFA Rules not processed for user `544278669a2d4884bcfc7c2f7dbff624`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:17.927912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1d6ef9df-f683-42a5-b652-8eb159ae8fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:18.038388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1235/2507] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:15:18.056592 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:18.058971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:18.086159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1fac7-c1f6-44ef-b4e2-6bc589eed170 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:18.097412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:18.098450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:18.098941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:18.099437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:18.115776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:18.119401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:18.136975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1273/2508] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:21.913879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf045c-09c8-4620-8efb-14e1a7686c5d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:21.914743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf045c-09c8-4620-8efb-14e1a7686c5d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:21.914743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf045c-09c8-4620-8efb-14e1a7686c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:21.953258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6adf045c-09c8-4620-8efb-14e1a7686c5d None None] MFA Rules not processed for user `544278669a2d4884bcfc7c2f7dbff624`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:21.955513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6adf045c-09c8-4620-8efb-14e1a7686c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:21.970400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1236/2509] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:15:28.129741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:31.941818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=51 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:35.076830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:35.090508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7122-0a41-4a6d-9849-d621eb7e4d10 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:35.096412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:35.097073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:35.097358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:35.097637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:35.099521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:35.114369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:35.116117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7226a2-14bd-4cd1-8ce4-9fa8184ea78d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:35.129265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1274/2510] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:45.124221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:01.457937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.458796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.458970 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.463033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1237/2511] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:16:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:16:01.471878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c185-3c87-4bfb-8b31-466d394b4541 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.473182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c185-3c87-4bfb-8b31-466d394b4541 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.479493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4c185-3c87-4bfb-8b31-466d394b4541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.574382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fac4c185-3c87-4bfb-8b31-466d394b4541 None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:01.575658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fac4c185-3c87-4bfb-8b31-466d394b4541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:01.627297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1275/2512] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:01.644679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:01.647024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:01.663172 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0c95b-3722-43c1-9dfe-8f18851b9ae8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:01.668373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:01.669108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.669395 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.669674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.679332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:01.681164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f86c-3606-4fa1-9b08-95ae78697eac service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:01.690954 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1238/2513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:01.826315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadf1f-8b89-426c-adeb-9166de35ec6f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.826788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadf1f-8b89-426c-adeb-9166de35ec6f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.827938 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadf1f-8b89-426c-adeb-9166de35ec6f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.830705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1276/2514] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:16:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:16:01.844211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.844734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.845229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.878831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:01.880152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:01.917980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1239/2515] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:01.929527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadf1f-8b89-426c-adeb-9166de35ec6f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:01.943682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadf1f-8b89-426c-adeb-9166de35ec6f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:01.948974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:01.949623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:01.949955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:01.950164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:01.966201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:01.967677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:01.984206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1277/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:11.909166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=18 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:11.978611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=39 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:13.370064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:13.390941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc16ba-29ae-4970-914d-067108b4be1d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:13.395831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:13.396767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:13.397249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:13.397535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:13.400174 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:13.578376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:13.581211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:13.614101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1240/2517] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:14.437338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:14.438865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:14.561279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddb21b-2a47-47eb-bdfc-b8e3c5d7daa5 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:14.565751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:14.566407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:14.566692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:14.566974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:14.569105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:14.609794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:14.612773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:14.636342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660909-85c3-4f82-bfa9-aba7fdefa09e service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:14.641374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:14.642336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:14.642622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:14.642898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:14.645565 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:14.673509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:14.674975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:14.686858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1278/2518] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:16:14.731871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:14.733392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:14.756621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1241/2519] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:19.335548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:19.339278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:19.496016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b275e-b1af-4110-b453-1c4414dbedae service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:19.501247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:19.502078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:19.502365 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:19.502646 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:19.504562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:19.518512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:19.520235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:19.533270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1279/2520] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:16:19.595622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:19.598066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:19.622282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec3829-32e5-45c3-b356-b25473fef1e5 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:19.627137 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:19.627803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:19.628171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:19.628459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] PATH_INFO: `/v3/users/dcb0911fad8c4d20ab2e832afd6bc51f` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:19.629712 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb0911fad8c4d20ab2e832afd6bc51f)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:19.631661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:20.112626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb0911fad8c4d20ab2e832afd6bc51f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.246345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb0911fad8c4d20ab2e832afd6bc51f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.246986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb0911fad8c4d20ab2e832afd6bc51f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.264744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb0911fad8c4d20ab2e832afd6bc51f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.268017 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-a876b394-7d7e-414e-b83d-e81fa32c874b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb0911fad8c4d20ab2e832afd6bc51f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.275738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1242/2521] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:19 2022] DELETE /identity/v3/users/dcb0911fad8c4d20ab2e832afd6bc51f => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:20.624039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:20.636437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4cec0-b844-467a-87a6-5d8334a0d30a service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:20.665215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:20.714238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:20.714913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:20.715196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:20.715474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] PATH_INFO: `/v3/projects/7a2dfeaed7b443eca8c347d9fb2688d0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:20.716898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2dfeaed7b443eca8c347d9fb2688d0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:20.719826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:20.885498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2dfeaed7b443eca8c347d9fb2688d0', 'request_id': 'req-a02cac3c-7edd-402d-acfb-b44834806df0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.983792 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2dfeaed7b443eca8c347d9fb2688d0', 'request_id': 'req-a02cac3c-7edd-402d-acfb-b44834806df0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:20.990539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2dfeaed7b443eca8c347d9fb2688d0', 'request_id': 'req-a02cac3c-7edd-402d-acfb-b44834806df0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:21.003510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] The token cache is being invalidate because project 7a2dfeaed7b443eca8c347d9fb2688d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:16:21.006782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:21.006782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a02cac3c-7edd-402d-acfb-b44834806df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:21.006782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1280/2522] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:20 2022] DELETE /identity/v3/projects/7a2dfeaed7b443eca8c347d9fb2688d0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:21.012727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.013398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.013398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.092233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:21.095637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:21.097010 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:21.182328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1243/2523] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:21.197018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.197568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.197825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.222070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:21.223486 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:21.232986 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1281/2524] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:21.237515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.249674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4eb89-dd1d-4ace-b4ec-cc77b7016f13 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.254928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.255595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.255877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.256152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.256979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:16:21.257290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.259513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:21.273477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1244/2525] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:16:21.278564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.292360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890842d6-ff12-47c6-990f-18a636c7fd42 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.297811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.300334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.300334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.300334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.300334 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.301756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:21.479267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1282/2526] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:16:21 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:21.482616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.496265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb242b2-7ea9-4dd2-9601-87476bb7df0c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.592653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.594678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.594678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.594927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.595923 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.599700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:21.755542 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1245/2527] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:16:21 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:21.761247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.780842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddcbab-16fc-4d3e-a076-ae142d9c1070 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.786841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.787598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.788003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.788423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.789366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.792200 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:21.808702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1283/2528] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:16:21.815755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.833598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150109b-c84b-4cdb-ad03-709952698d6b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.841535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.842434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.843460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.843460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.845261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.846898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4e389-cd92-4931-9ed0-7fcd991c76b5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:21.873057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1246/2529] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:16:21.881684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:21.895023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615c00-ae28-4f1f-b440-aec4261ad9bc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:21.903374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:21.904539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:21.904934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:21.905336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] PATH_INFO: `/v3/projects/57e0500977c6492888753fc9c388893e/users/587202b8159e42b79cd1e2753e970613/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:21.933033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e0500977c6492888753fc9c388893e, user_id=587202b8159e42b79cd1e2753e970613, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:21.937141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:22.030460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1284/2530] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:21 2022] PUT /identity/v3/projects/57e0500977c6492888753fc9c388893e/users/587202b8159e42b79cd1e2753e970613/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:22.043837 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:22.044722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:22.044722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:22.085912 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] MFA Rules not processed for user `587202b8159e42b79cd1e2753e970613`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:22.087472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:22.197425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1247/2531] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:22.204262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:22.290622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:22.311377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feed89-2afc-4f2a-82f6-27fbfbc52ab1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:22.317521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:22.318064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:22.318455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:22.318694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:22.319439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:22.325831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:22.458047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1285/2532] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:16:22 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:22.463859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:22.471044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:22.477842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07642ba4-f043-4187-9bd4-7021357bc1a7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:22.571258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:22.573099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:22.573955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:22.574449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:22.575674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:22.580450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:22.725005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1248/2533] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:16:22 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:22.730971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:22.746212 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc6223-2ef7-49f6-a762-f809c14cb451 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:22.752186 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:22.753352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:22.753352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:22.753697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:22.754101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:22.756013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:22.788581 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1286/2534] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:16:22.794110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:22.804809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ee953-6eef-437c-85b7-098d77ffe57e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:22.810581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:22.811265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:22.811553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:22.812024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] PATH_INFO: `/v3/projects/98ba6693017448fea5f9a30e922d10e5/users/49396767bd874b869138fdf37e85fcfc/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:22.829760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ba6693017448fea5f9a30e922d10e5, user_id=49396767bd874b869138fdf37e85fcfc, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:22.832560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:22.968651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1249/2535] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:22 2022] PUT /identity/v3/projects/98ba6693017448fea5f9a30e922d10e5/users/49396767bd874b869138fdf37e85fcfc/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:22.972574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:22.984356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8fba-fd1e-4401-b19a-37682a604dfb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:23.055146 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:23.056028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:23.056028 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:23.056369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:23.057070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:23.058734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3e64-fb79-4b7e-8eb4-60bb3bdcbd09 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:23.071041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1287/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:16:23.077246 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:23.091488 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cae65a-8434-4a89-8f1c-efddd18e9849 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:23.096369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:23.097292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:23.097605 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:23.097879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] PATH_INFO: `/v3/projects/98ba6693017448fea5f9a30e922d10e5/users/49396767bd874b869138fdf37e85fcfc/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:23.099856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ba6693017448fea5f9a30e922d10e5, user_id=49396767bd874b869138fdf37e85fcfc, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:23.103873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:23.116486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1250/2537] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:23 2022] PUT /identity/v3/projects/98ba6693017448fea5f9a30e922d10e5/users/49396767bd874b869138fdf37e85fcfc/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:23.140315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:23.141128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:23.141501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:23.181142 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] MFA Rules not processed for user `49396767bd874b869138fdf37e85fcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:23.182351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:23.287474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1288/2538] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:23.301516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:23.303420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:23.374497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ea5f-9906-4433-b52c-dba156ba7578 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:23.379155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:23.379727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:23.380020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:23.380293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:23.452207 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:23.453854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bf070-29db-48c0-84aa-f026e42a6741 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:23.466088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1251/2539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:28.613457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:28.615837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:28.635749 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6157-a6d8-4a50-bcac-7b4227e70671 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:28.640733 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:28.641645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:28.642275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:28.642708 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:28.659378 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:28.662063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:28.676432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1289/2540] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:33.460472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:38.671452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:42.418071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:42.418800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:42.418800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:42.444005 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:42.446294 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:42.532183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1252/2541] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:42.714120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:42.715161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:42.869156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236f5f-abf6-4770-b67e-930e784af0b8 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:42.875504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:42.876326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:42.876657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:42.876939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:42.888125 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:42.889819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:42.899993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1290/2542] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:16:44.064081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:44.066315 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:44.169608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c812-7eac-4d01-af92-82ffb216e238 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:44.173782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:44.174657 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:44.175099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:44.175380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:44.177860 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:44.268639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:44.271140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc91707-a3ae-425e-98c8-7e3c3f1cb4f9 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:44.284340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1253/2543] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:46.740176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:46.764133 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6ae1-4cf3-43ff-a6b6-7624c8c8377c service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:46.772465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:46.774943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:46.775700 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:46.776209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] PATH_INFO: `/v3/users/587202b8159e42b79cd1e2753e970613` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:46.779005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587202b8159e42b79cd1e2753e970613)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:46.783033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:47.168976 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587202b8159e42b79cd1e2753e970613'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:47.272817 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587202b8159e42b79cd1e2753e970613'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:47.273575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587202b8159e42b79cd1e2753e970613'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:47.341222 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587202b8159e42b79cd1e2753e970613'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:47.381638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587202b8159e42b79cd1e2753e970613'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:47.416000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1291/2544] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:46 2022] DELETE /identity/v3/users/587202b8159e42b79cd1e2753e970613 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:47.420617 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:47.421654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:47.422226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:47.483681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:47.492061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:47.626532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:47.644822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1254/2545] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:47.659631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:47.661991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:47.825441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4a68-f937-4052-ae93-b60ae5d55c31 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:47.829816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:47.830449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:47.830730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:47.831004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:47.843111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:47.844957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:47.880483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1292/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:48.684249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:48.688267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:48.759426 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b1a5-5c0e-4344-a659-bcf45e4ee1c4 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:48.769945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:48.772216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:48.773216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:48.774089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] PATH_INFO: `/v3/projects/57e0500977c6492888753fc9c388893e` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:48.776816 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e0500977c6492888753fc9c388893e)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:48.781801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:49.006434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e0500977c6492888753fc9c388893e', 'request_id': 'req-18dc8282-0118-4234-8410-4ad59c3f6cf6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.171511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e0500977c6492888753fc9c388893e', 'request_id': 'req-18dc8282-0118-4234-8410-4ad59c3f6cf6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.215746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e0500977c6492888753fc9c388893e', 'request_id': 'req-18dc8282-0118-4234-8410-4ad59c3f6cf6'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.259125 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] The token cache is being invalidate because project 57e0500977c6492888753fc9c388893e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:16:49.259645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.260974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.263960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1255/2547] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:48 2022] DELETE /identity/v3/projects/57e0500977c6492888753fc9c388893e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:16:49.269458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:49.278144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:49.284705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba88b9c-a831-4d2d-b3fa-c3439e8045da service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:49.370476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:49.371468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:49.371917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:49.372698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] PATH_INFO: `/v3/users/49396767bd874b869138fdf37e85fcfc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:49.376000 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49396767bd874b869138fdf37e85fcfc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:49.387458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:49.735528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49396767bd874b869138fdf37e85fcfc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.897676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49396767bd874b869138fdf37e85fcfc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.899173 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49396767bd874b869138fdf37e85fcfc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.946476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49396767bd874b869138fdf37e85fcfc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.957967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49396767bd874b869138fdf37e85fcfc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:49.967713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1293/2548] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:49 2022] DELETE /identity/v3/users/49396767bd874b869138fdf37e85fcfc => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:50.738440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:50.740915 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:50.806856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8282-0118-4234-8410-4ad59c3f6cf6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:50.994661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:50.995776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:50.996578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:50.997095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] PATH_INFO: `/v3/projects/98ba6693017448fea5f9a30e922d10e5` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:50.999407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ba6693017448fea5f9a30e922d10e5)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:51.008795 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:51.235120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:51.242295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:51.250817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ba6693017448fea5f9a30e922d10e5', 'request_id': 'req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:51.269987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cdbe9-0f36-4c6c-9c36-28e22a22ef1c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:51.388688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:51.389955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:51.402524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:51.402524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] PATH_INFO: `/v3/users/f1421549f2c34db8a75176ecef573353` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:51.402524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1421549f2c34db8a75176ecef573353)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:51.402524 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:51.438962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ba6693017448fea5f9a30e922d10e5', 'request_id': 'req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:51.453890 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ba6693017448fea5f9a30e922d10e5', 'request_id': 'req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:51.482240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] The token cache is being invalidate because project 98ba6693017448fea5f9a30e922d10e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:16:51.482560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:51.483319 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-fbc0bb05-5185-43d8-ba78-9f86a3fe6854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:51.490367 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1256/2549] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:50 2022] DELETE /identity/v3/projects/98ba6693017448fea5f9a30e922d10e5 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:51.492500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8655-6592-4fc6-a660-738c2a0df77a None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:51.493136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8655-6592-4fc6-a660-738c2a0df77a None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:51.493604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a8655-6592-4fc6-a660-738c2a0df77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:51.526811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-742a8655-6592-4fc6-a660-738c2a0df77a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:51.526811 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-742a8655-6592-4fc6-a660-738c2a0df77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:51.536603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1257/2550] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:51.547199 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:51.549791 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:51.550288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:51.550753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:51.569171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:51.589800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:51.591061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:51.599312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1258/2551] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:51.604776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:51.616980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717901fb-bd2c-4849-ac09-3a3b66cb37e0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:51.622798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:51.623535 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:51.623819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:51.624101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:51.624817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:16:51.625123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:51.626803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:51.642269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1259/2552] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:16:51.647006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:51.659037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ea76e-ef27-4e46-96b8-e3c134b23dee admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:51.665999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:51.666774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:51.667116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:51.667437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:51.668139 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:51.670199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.128981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1260/2553] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:16:52.133633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:52.138769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1421549f2c34db8a75176ecef573353'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:52.250258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1421549f2c34db8a75176ecef573353'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:52.251359 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1421549f2c34db8a75176ecef573353'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:52.256167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b4ba-5eb4-432a-899a-760004f37f5c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:52.266739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:52.268035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.269051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.269718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.272768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:52.277827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.289707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1421549f2c34db8a75176ecef573353'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:52.308776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1421549f2c34db8a75176ecef573353'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:52.323589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1294/2554] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:51 2022] DELETE /identity/v3/users/f1421549f2c34db8a75176ecef573353 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:52.410179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1261/2555] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:16:52 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:16:52.415861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:52.417648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:52.541047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8450c-66af-4c6d-b1db-90e9d6207518 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:52.549349 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:52.550161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.550595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.550936 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.552673 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:52.554469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.577864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1295/2556] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:16:52.583514 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:52.606417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd7b1-5c38-4835-9e8c-0ff0dc0489d5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:52.615354 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:52.616440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.616990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.618372 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.619566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:52.622866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.652733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1262/2557] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:16:52.653118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:52.672999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff577-36d9-46e7-9d6f-b236baba6069 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:52.682549 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:52.683729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.687820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.687820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] PATH_INFO: `/v3/projects/88e993f189184a9d9ac6aea33ea03dd7/users/1aa67671a40a4566af745d8d3414a5e8/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.719243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e993f189184a9d9ac6aea33ea03dd7, user_id=1aa67671a40a4566af745d8d3414a5e8, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:52.724763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:52.725030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f655b-a81b-4695-8887-211dfddf352c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.727275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:52.754088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed5717-3a36-47df-96f4-6c965bf3ae50 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:52.762028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:52.763272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.763272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.763272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] PATH_INFO: `/v3/projects/b8eeda03b1ab4c3e8fa035b3566d7e49` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.764492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eeda03b1ab4c3e8fa035b3566d7e49)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:52.766675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:52.849623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1296/2558] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:52 2022] PUT /identity/v3/projects/88e993f189184a9d9ac6aea33ea03dd7/users/1aa67671a40a4566af745d8d3414a5e8/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:16:52.867625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:52.868225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:52.868761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:52.904436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] MFA Rules not processed for user `1aa67671a40a4566af745d8d3414a5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:52.905871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:52.951611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eeda03b1ab4c3e8fa035b3566d7e49', 'request_id': 'req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:53.008624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1297/2559] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:53.014638 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.025574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:53.046114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eeda03b1ab4c3e8fa035b3566d7e49', 'request_id': 'req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:53.056362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eeda03b1ab4c3e8fa035b3566d7e49', 'request_id': 'req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:53.082719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] The token cache is being invalidate because project b8eeda03b1ab4c3e8fa035b3566d7e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:16:53.083160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:53.083934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-6e68ab92-c65d-4333-a6f0-d14fe2c3cd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:53.087085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1263/2560] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:52 2022] DELETE /identity/v3/projects/b8eeda03b1ab4c3e8fa035b3566d7e49 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:16:53.093607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5c85-5fc6-415d-805c-84f20460b518 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.094278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5c85-5fc6-415d-805c-84f20460b518 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.095364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5c85-5fc6-415d-805c-84f20460b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.138612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b96d5c85-5fc6-415d-805c-84f20460b518 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:53.140096 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b96d5c85-5fc6-415d-805c-84f20460b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:53.158945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aab1e-eceb-45d9-b81b-3f7aee2beade None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.185785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:53.253714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.254851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.255325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.255812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.257074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.261157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.313692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1264/2561] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:53.327534 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.329412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.329412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.378316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:53.381625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:53.408499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1265/2562] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:16:53.410364 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.432140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f5d6-428e-4d35-8db5-036703246e54 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.448253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.449877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.450727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.453660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.455742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:16:53.456380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.459255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1298/2563] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/projects => generated 385 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:16:53.464376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.466967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.470417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:53.495202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1266/2564] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:16:53.500986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.517008 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ff22-fa8d-434a-808e-9c1bd38c2a28 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.630243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65577a45-b64a-4e67-8723-54373f861ca5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.640243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.642149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.643002 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.643947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.645435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.645633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.646307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.646818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.647316 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.649050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.652267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.653263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.791045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1299/2565] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:53.795978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.809535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71c40-ecb2-41fe-a700-cb0a660e6527 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.814328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1267/2566] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:53.815719 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.852768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:53.921599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.922336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.922694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.922997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696e3d4-8581-4f96-a217-bcb99e398dbb admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:53.923261 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.923966 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.927238 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.933843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:53.934582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:53.934869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:53.935143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:53.938873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:53.938873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:53.960825 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1300/2567] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:16:53.973301 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:53.996577 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11a40-f9c0-4363-b7e0-214b83858f6c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.004420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.005285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.005808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.006156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] PATH_INFO: `/v3/projects/b76761fd7853411e8ea0c06442fc4046/users/846bb90b5bf74f07ab9d2b00254c5aec/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.042570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76761fd7853411e8ea0c06442fc4046, user_id=846bb90b5bf74f07ab9d2b00254c5aec, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.049417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.059770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1268/2568] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:16:53 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:16:54.064242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.080417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24ab8a-a9a4-4df0-a894-4f1039043b20 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.088411 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.089683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.090690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.091277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.092768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.097273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.120088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1269/2569] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:16:54.125817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.138557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32cca-3b5b-483b-bd2d-9f158c332ec6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.145375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.146110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.146608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.146991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.147869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.150237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.152296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:54.176593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1270/2570] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:16:54.184286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.190297 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1301/2571] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:53 2022] PUT /identity/v3/projects/b76761fd7853411e8ea0c06442fc4046/users/846bb90b5bf74f07ab9d2b00254c5aec/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:54.194652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.211655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43221ccc-9de9-47ba-9c8b-83b4ecd0266c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.310688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf5967-7a72-4e86-8539-4cd2a25954d9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.315352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.316143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.316533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.316990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] PATH_INFO: `/v3/projects/0ddab971038c4004bbd6f905140b28cf/users/c67cf9da05cd4b469281acf12adfd5da/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.317901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.318767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.319397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.319895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.320721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.322439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.340290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1302/2572] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:16:54.342411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.346490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddab971038c4004bbd6f905140b28cf, user_id=c67cf9da05cd4b469281acf12adfd5da, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.352487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8ae04-b955-435c-a41f-7e964958e37d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.354589 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e64-844b-45a1-aa92-33347db208db admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.361218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.362540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.363097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.363647 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] PATH_INFO: `/v3/projects/b76761fd7853411e8ea0c06442fc4046/users/846bb90b5bf74f07ab9d2b00254c5aec/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.366326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76761fd7853411e8ea0c06442fc4046, user_id=846bb90b5bf74f07ab9d2b00254c5aec, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.370529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3f0ef-6260-409c-ba63-f12aedae7130 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:54.385136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1303/2573] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:54 2022] PUT /identity/v3/projects/b76761fd7853411e8ea0c06442fc4046/users/846bb90b5bf74f07ab9d2b00254c5aec/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:16:54.401692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.402275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.402657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.461591 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] MFA Rules not processed for user `846bb90b5bf74f07ab9d2b00254c5aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:54.466112 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:54.523198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1271/2574] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:16:54 2022] PUT /identity/v3/projects/0ddab971038c4004bbd6f905140b28cf/users/c67cf9da05cd4b469281acf12adfd5da/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:54.525831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.526403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.526958 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.581967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] MFA Rules not processed for user `c67cf9da05cd4b469281acf12adfd5da`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:54.584138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:54.705551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1304/2575] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:54.725631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.727514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:54.751109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:54.766857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1272/2576] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:54.786449 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:54.789296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:54.871649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24790-d51d-4caa-8e29-084c4d13e029 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.948874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cff29-82ab-4d95-89e6-a73b19f5c86b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:54.957109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.957941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.958314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.958692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.959286 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:54.960122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:54.960854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:54.961987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:54.973831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:54.981357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:54.986379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:55.010371 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1273/2577] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:55.110701 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:55.113362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd87178-7b35-4bb3-9f36-d8279d63f06c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:55.139023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1305/2578] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:55.182130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:55.317231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041ba05-e592-45df-b715-8dba6a17f2e7 service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:55.323905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:55.324918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:55.325198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:55.327774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] PATH_INFO: `/v3/users/1aa67671a40a4566af745d8d3414a5e8` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:55.329265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa67671a40a4566af745d8d3414a5e8)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:55.331910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:55.575896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa67671a40a4566af745d8d3414a5e8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:55.652196 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa67671a40a4566af745d8d3414a5e8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:55.653175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa67671a40a4566af745d8d3414a5e8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:55.686141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa67671a40a4566af745d8d3414a5e8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:55.704668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa67671a40a4566af745d8d3414a5e8'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:55.717065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1274/2579] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:55 2022] DELETE /identity/v3/users/1aa67671a40a4566af745d8d3414a5e8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:55.725329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:55.727073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:55.728412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:55.770677 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:55.772868 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:55.918668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1306/2580] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:55.941768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:55.946290 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:56.191110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410471-79df-4bef-ac33-eeaacc24ddef admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:56.198459 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:56.199902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:56.200480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:56.201102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:56.219302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:56.220825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:56.232143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1275/2581] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:57.379174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:57.381438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:57.400520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401c45-4ae1-4b49-bda2-47d93345c88c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:57.406720 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:57.407535 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:57.407864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:57.408150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] PATH_INFO: `/v3/projects/88e993f189184a9d9ac6aea33ea03dd7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:57.409539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e993f189184a9d9ac6aea33ea03dd7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:57.416783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:57.428060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:57.580978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e993f189184a9d9ac6aea33ea03dd7', 'request_id': 'req-465f2ff1-4504-4e32-8347-6cad229c3dc9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:57.723576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e993f189184a9d9ac6aea33ea03dd7', 'request_id': 'req-465f2ff1-4504-4e32-8347-6cad229c3dc9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:57.738016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e993f189184a9d9ac6aea33ea03dd7', 'request_id': 'req-465f2ff1-4504-4e32-8347-6cad229c3dc9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:57.763958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] The token cache is being invalidate because project 88e993f189184a9d9ac6aea33ea03dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:16:57.764389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:57.765622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:57.771401 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1307/2582] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:57 2022] DELETE /identity/v3/projects/88e993f189184a9d9ac6aea33ea03dd7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:57.772839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:57.790321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c16a0e-c6fe-44fc-9266-093027af8c8d service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:57.817255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:57.895798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:57.896477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:57.896819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:57.897118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] PATH_INFO: `/v3/users/846bb90b5bf74f07ab9d2b00254c5aec` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:57.898448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=846bb90b5bf74f07ab9d2b00254c5aec)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:57.900865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:58.490960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846bb90b5bf74f07ab9d2b00254c5aec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:58.802358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846bb90b5bf74f07ab9d2b00254c5aec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:58.807170 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846bb90b5bf74f07ab9d2b00254c5aec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:58.819492 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846bb90b5bf74f07ab9d2b00254c5aec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:58.845687 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0d342588-476a-4287-aa8b-b9b879dfb6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846bb90b5bf74f07ab9d2b00254c5aec'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:16:58.859356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1276/2583] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:16:57 2022] DELETE /identity/v3/users/846bb90b5bf74f07ab9d2b00254c5aec => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:16:59.735667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:59.738978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:59.757533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f2ff1-4504-4e32-8347-6cad229c3dc9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:59.837601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:59.838267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:59.838548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:59.838850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] PATH_INFO: `/v3/projects/b76761fd7853411e8ea0c06442fc4046` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:59.840046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76761fd7853411e8ea0c06442fc4046)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:59.842053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:00.146750 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76761fd7853411e8ea0c06442fc4046', 'request_id': 'req-dc59ea7c-646f-4028-ae0f-ff879e493a4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:00.263659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76761fd7853411e8ea0c06442fc4046', 'request_id': 'req-dc59ea7c-646f-4028-ae0f-ff879e493a4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:00.275188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76761fd7853411e8ea0c06442fc4046', 'request_id': 'req-dc59ea7c-646f-4028-ae0f-ff879e493a4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:00.295794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] The token cache is being invalidate because project b76761fd7853411e8ea0c06442fc4046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:00.296383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:00.297562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dc59ea7c-646f-4028-ae0f-ff879e493a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:00.299537 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1308/2584] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:16:59 2022] DELETE /identity/v3/projects/b76761fd7853411e8ea0c06442fc4046 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:00.308552 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.309397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.309397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.335128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:00.337140 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:00.432754 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1277/2585] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:00.435337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248077f-9223-4249-b4a4-299559058538 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.435810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248077f-9223-4249-b4a4-299559058538 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.436196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248077f-9223-4249-b4a4-299559058538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.473110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f248077f-9223-4249-b4a4-299559058538 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:00.475525 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f248077f-9223-4249-b4a4-299559058538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:00.487948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1309/2586] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:00.492228 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:00.505637 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9733ca-409d-4189-81ae-5aae9781252b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:00.512872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:00.514144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.514634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.515101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.516142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:00.516827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:00.518960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:00.539815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1278/2587] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:17:00.546743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248077f-9223-4249-b4a4-299559058538 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:00.561640 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248077f-9223-4249-b4a4-299559058538 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:00.567862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:00.568502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.568907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.569180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.569973 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:00.572331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:00.730478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:00.745710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1310/2588] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:00 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:17:00.749955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:00.762764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e523-15c1-4547-9fcb-fff9687e7a3d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:00.785917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:00.837529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:00.838176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.838467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.838747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.839428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:00.841513 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:00.969925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1279/2589] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:00 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:00.973956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:00.985498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88ab23-b628-4060-ad9c-c94fc8f032fb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:00.990729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:00.991377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:00.991662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:00.991972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:00.993457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:00.995148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.007088 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1311/2590] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:01.013348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.025455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe04d0-e5a7-49ed-aceb-18e6d644a27b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.030740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.031428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.031710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.032029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.032740 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.034462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98761-5ba7-49b9-a2c7-f6557630e329 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.047417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1280/2591] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:01.051816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.063527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797eb20-d8b7-4e47-9d7e-f57636125351 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.068610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.069321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.069609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.069891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] PATH_INFO: `/v3/projects/b5ad0f247a4a4f269437785d586f5130/users/a7589fa2882e4c9c972f17fdce685def/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.090802 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ad0f247a4a4f269437785d586f5130, user_id=a7589fa2882e4c9c972f17fdce685def, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.093586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.214637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1312/2592] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:01 2022] PUT /identity/v3/projects/b5ad0f247a4a4f269437785d586f5130/users/a7589fa2882e4c9c972f17fdce685def/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:01.234649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.235037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.235380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.274932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] MFA Rules not processed for user `a7589fa2882e4c9c972f17fdce685def`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:01.277373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:01.398262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1281/2593] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:01.403517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.480985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbef0-14da-495a-8696-7365368f6298 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.486605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.487293 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.487622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.487956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.488809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.491004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.614584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1313/2594] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:01 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:17:01.620700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.634891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564259c-60b0-4350-a8d4-c15b94b3446d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.732014 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.733072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.733504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.733878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.734876 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.738128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.860499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1282/2595] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:01 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:01.863282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.865096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2567a-8b8b-4303-b06f-33d9893f3dec admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.871143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.872105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.872604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.873054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.874059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.875815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.891551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1314/2596] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:01.896745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:01.908218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c933f-7085-4c4b-9db1-fc1009b16ac6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:01.913682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:01.915475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:01.916391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:01.916391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] PATH_INFO: `/v3/projects/d795193f94a145219ca26fdce9f4662e/users/0a2e264a166d46a18cc6346cb558c51c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:01.935623 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d795193f94a145219ca26fdce9f4662e, user_id=0a2e264a166d46a18cc6346cb558c51c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:01.938430 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:01.942144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:02.037136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1283/2597] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:01 2022] PUT /identity/v3/projects/d795193f94a145219ca26fdce9f4662e/users/0a2e264a166d46a18cc6346cb558c51c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:02.041517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:02.053179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290146-266f-4d9f-8320-96b4561db3e6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:02.125005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:02.125005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:02.125005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:02.125321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:02.125764 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:02.127586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc193c-3332-4e98-bc5b-d2ff6c676ee6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:02.140354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1315/2598] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:02.145853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:02.157839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69932d-af67-4886-bf2d-dfb072e2b3b7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:02.162968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:02.163656 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:02.164859 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:02.165382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] PATH_INFO: `/v3/projects/d795193f94a145219ca26fdce9f4662e/users/0a2e264a166d46a18cc6346cb558c51c/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:02.167736 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d795193f94a145219ca26fdce9f4662e, user_id=0a2e264a166d46a18cc6346cb558c51c, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:02.170684 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:02.186448 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1284/2599] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:02 2022] PUT /identity/v3/projects/d795193f94a145219ca26fdce9f4662e/users/0a2e264a166d46a18cc6346cb558c51c/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:02.197371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:02.197756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:02.198104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:02.233144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] MFA Rules not processed for user `0a2e264a166d46a18cc6346cb558c51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:02.234561 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:02.260911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:02.334727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1316/2600] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:02.348783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:02.351115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:02.433942 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201784fe-2e72-491a-980c-b44dd00cdfc0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:02.441452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:02.442288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:02.442957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:02.443432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:02.556003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:02.559313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c5374-48e5-4b9a-a08c-4eaf9e4dbdfe service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:02.579146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1285/2601] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:03.434496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:03.434496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:03.542431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da539e-6c14-4421-ae17-5e46278d122d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:03.551833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:03.553302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:03.553822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:03.558160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] PATH_INFO: `/v3/users/c67cf9da05cd4b469281acf12adfd5da` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:03.558160 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67cf9da05cd4b469281acf12adfd5da)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:03.560546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:03.848303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67cf9da05cd4b469281acf12adfd5da'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:03.937695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67cf9da05cd4b469281acf12adfd5da'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:03.938543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67cf9da05cd4b469281acf12adfd5da'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:03.967489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67cf9da05cd4b469281acf12adfd5da'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:03.980035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67cf9da05cd4b469281acf12adfd5da'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:03.987451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1317/2602] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:03 2022] DELETE /identity/v3/users/c67cf9da05cd4b469281acf12adfd5da => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:03.992674 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:03.993481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:03.993481 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:04.018580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:04.019893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:04.098701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1286/2603] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:04.119684 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:04.124068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:04.188582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:04.207586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81d3e-b187-4a37-989a-99a5156843b1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:04.212209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:04.212961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:04.213288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:04.213621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:04.225163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:04.227069 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb377ffd-7a2c-441f-b0d2-a473b0b51943 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:04.242681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1318/2604] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:04.844533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:04.846235 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:04.860889 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f5c9c-28b1-494d-899c-417ec906414e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:04.866107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:04.867786 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:04.868365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:04.868881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] PATH_INFO: `/v3/projects/0ddab971038c4004bbd6f905140b28cf` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:04.873760 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddab971038c4004bbd6f905140b28cf)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:04.881702 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.043424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:05.058891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddab971038c4004bbd6f905140b28cf', 'request_id': 'req-e2c5e15e-672d-4cdd-9e79-3537d1168048'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:05.160700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddab971038c4004bbd6f905140b28cf', 'request_id': 'req-e2c5e15e-672d-4cdd-9e79-3537d1168048'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:05.168700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddab971038c4004bbd6f905140b28cf', 'request_id': 'req-e2c5e15e-672d-4cdd-9e79-3537d1168048'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:05.183529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] The token cache is being invalidate because project 0ddab971038c4004bbd6f905140b28cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:05.183820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:05.184487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e2c5e15e-672d-4cdd-9e79-3537d1168048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:05.186040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1287/2605] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:04 2022] DELETE /identity/v3/projects/0ddab971038c4004bbd6f905140b28cf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:05.191286 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.192692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.192692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.217009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:05.218449 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:05.316838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1319/2606] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:05.326938 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.327493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.327945 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.356874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:05.358477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:05.368615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1288/2607] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:05.373757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:05.385387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f127ad-8d79-443e-a716-3a94a178ce06 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:05.390648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:05.391291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.391578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.391855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.392552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:05.392898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:05.394689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.409607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1320/2608] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:17:05.417894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:05.439728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b9c4d-bd0b-42a1-8cbf-b24d080988f8 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:05.446480 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:05.447403 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.447801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.448121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.448894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:05.451765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.584313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1289/2609] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:05 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:05.587113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:05.608859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900a573-c208-42b6-a6eb-43183a5dcd4c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:05.730081 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:05.730745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.731095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.731471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.732128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:05.734175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.883243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1321/2610] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:05 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:05.888192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:05.909621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b257-0218-469d-88af-36c484dc9996 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:05.919618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:05.920659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.921166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.921625 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.923037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:05.928626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.941206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1290/2611] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:17:05.946996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:05.963101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501c36-766a-4fe4-8a04-8f0a781f99e8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:05.968710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:05.969351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:05.969719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:05.969896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:05.970632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:05.972358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a65de-9387-4812-8792-fd16939ac392 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:05.986130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1322/2612] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:17:05.991013 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:06.002990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52b10-f168-40d8-a0fd-5b2e61214e4c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:06.008084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:06.008903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.009182 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.009462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] PATH_INFO: `/v3/projects/44d9d4188a9149e9a8f0a5a4d1131330/users/421305aa13dc4689800010d9220facd2/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.033280 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d9d4188a9149e9a8f0a5a4d1131330, user_id=421305aa13dc4689800010d9220facd2, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:06.039571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f421b0-e2a3-43d3-bd69-165aba6fa0ad admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:06.186638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1291/2613] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:05 2022] PUT /identity/v3/projects/44d9d4188a9149e9a8f0a5a4d1131330/users/421305aa13dc4689800010d9220facd2/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:06.192958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9eb8b-a7ac-47a4-bebf-1fc43c96af37 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.203777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9eb8b-a7ac-47a4-bebf-1fc43c96af37 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.203777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9eb8b-a7ac-47a4-bebf-1fc43c96af37 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.203777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1323/2614] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:17:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:17:06.204320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.204320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.204320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.207730 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.208138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.208501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.237033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:06.238480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:06.251586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] MFA Rules not processed for user `421305aa13dc4689800010d9220facd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:06.253821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:06.321915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:06.357089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1292/2615] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:06.364341 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:06.374374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1324/2616] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:06.393631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:06.396143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:06.450453 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:06.471724 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3684-6539-4598-8219-5eab5b89cda7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:06.476341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7106b4-bf73-4f83-a3de-3a5356b55080 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:06.478266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:06.478911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.479224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.479510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.480187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:06.481827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:06.482262 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:06.482895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.483481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.483900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.500847 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:06.503488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:06.524171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1325/2617] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:06.624160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1293/2618] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:06 2022] POST /identity/v3/projects => generated 363 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:17:06.628801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:06.641566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e552fe-fa62-4d99-b339-8a6a24259417 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:06.718593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:06.719239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.726872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.726872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.726872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:06.726872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48512bed-a30a-45e3-9ecf-ea953c97ab5c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:06.922874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1326/2619] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:06 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:06.924505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:06.937787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb08c-7f7f-4bca-9f82-64d968bd5baa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.937787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb08c-7f7f-4bca-9f82-64d968bd5baa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.937787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cb08c-7f7f-4bca-9f82-64d968bd5baa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.945162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1327/2620] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:17:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:17:06.945549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ee821-d5ab-429d-951a-b8b905855e03 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:06.951184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.951656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.952049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.958396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:06.959203 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:06.959491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:06.959765 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:06.960440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:06.962397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:06.987060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] MFA Rules not processed for user `f8d65bfd6aed4083a04c5dc277cfb85f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:06.987613 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1294/2621] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:17:06.989033 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:06.995812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.015377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773bb1-5883-4f66-afc9-39711e064c86 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.024177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.025562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.026021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.029251 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] PATH_INFO: `/v3/projects/5a162bd04a224c12bbf0de372d34767d/users/165a8afd791b4363994e659e017d7546/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.057058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a162bd04a224c12bbf0de372d34767d, user_id=165a8afd791b4363994e659e017d7546, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.062815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce342645-1ee4-4c8a-af00-1a9cbd61c95a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.064169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1328/2622] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:07.081596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.083530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:07.097543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5afca6-2333-4cd1-8f72-6cf53ff2c2ea None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.102714 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.103352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.103636 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.103945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.114845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.117789 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.133629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1329/2623] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:07.189857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1295/2624] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:06 2022] PUT /identity/v3/projects/5a162bd04a224c12bbf0de372d34767d/users/165a8afd791b4363994e659e017d7546/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:07.194852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.210255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95991e-464a-49f0-925e-04bbfead4b16 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.218462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:07.249796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc136d9-2d8a-4b8b-9aa4-261c9dfa315b None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.250224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc136d9-2d8a-4b8b-9aa4-261c9dfa315b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.250596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc136d9-2d8a-4b8b-9aa4-261c9dfa315b None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.252011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1296/2625] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:17:07.259632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.260103 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.260612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.295555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:07.298612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:07.331977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.333262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.334157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.334781 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.336775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.339776 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.356635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1330/2626] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:07.362527 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.377050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4c2d8-eaee-4a60-bb3f-bde5f205ff8d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.386100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.387273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.387769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.388263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] PATH_INFO: `/v3/projects/5a162bd04a224c12bbf0de372d34767d/users/165a8afd791b4363994e659e017d7546/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.392384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a162bd04a224c12bbf0de372d34767d, user_id=165a8afd791b4363994e659e017d7546, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.397872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56d995-87d1-44a8-b46f-d254ed3b659a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.419203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1331/2627] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:07 2022] PUT /identity/v3/projects/5a162bd04a224c12bbf0de372d34767d/users/165a8afd791b4363994e659e017d7546/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:07.432191 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1297/2628] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:07.439235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.439746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.440243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.447568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.503224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] MFA Rules not processed for user `165a8afd791b4363994e659e017d7546`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:07.517053 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:07.553420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f75e8c-aa5b-4b37-8df2-61a1cbee2e6d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.627663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:07.632104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.633219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.633679 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.633984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1332/2629] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:07.634171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.655803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:07.659773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:07.779056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.780787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.786196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967a4b-4027-48fe-9e19-ff2a2064986e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:07.791105 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:07.791744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:07.792024 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:07.792304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:07.798221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1298/2630] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:07.816682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:07.818353 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:07.832217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1333/2631] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:08.928440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:08.930723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:08.944211 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae26012-9f7d-434d-a7e9-83499d36a581 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:08.955361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:08.956215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:08.956594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:08.956950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:08.959266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:09.059755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:09.061574 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87a566-d9c5-4ebc-8861-1901b4c73921 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:09.074963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1299/2632] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:09.162109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:09.186871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:09.253702 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf416bd4-b4e9-4ae0-9979-e47b637b366d service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:09.262288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:09.263108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:09.263606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:09.264855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] PATH_INFO: `/v3/users/421305aa13dc4689800010d9220facd2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:09.265687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421305aa13dc4689800010d9220facd2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:09.269149 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:09.748674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421305aa13dc4689800010d9220facd2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:09.973503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421305aa13dc4689800010d9220facd2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:09.974468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421305aa13dc4689800010d9220facd2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:09.997890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421305aa13dc4689800010d9220facd2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:10.012915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421305aa13dc4689800010d9220facd2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:10.021104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1334/2633] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:09 2022] DELETE /identity/v3/users/421305aa13dc4689800010d9220facd2 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:10.030160 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:10.034476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:10.034476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:10.065344 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:10.067004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:10.138536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1300/2634] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:10.149546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:10.151245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:10.235161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1bc2a-eae4-4558-8151-687eac9ffe34 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:10.239656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:10.240450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:10.240904 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:10.241326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:10.257109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:10.260067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:10.283889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1335/2635] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:10.943521 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:10.945910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:10.970209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecdc08-bf66-4a25-b867-e00533b204ff None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:10.986104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:10.987241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:10.987746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:10.988273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] PATH_INFO: `/v3/projects/44d9d4188a9149e9a8f0a5a4d1131330` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:10.990926 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d9d4188a9149e9a8f0a5a4d1131330)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:10.994261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:11.015016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:11.155580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d9d4188a9149e9a8f0a5a4d1131330', 'request_id': 'req-3cd97c54-b4ce-4b2f-affb-2681d73c31db'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.263793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d9d4188a9149e9a8f0a5a4d1131330', 'request_id': 'req-3cd97c54-b4ce-4b2f-affb-2681d73c31db'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.273974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d9d4188a9149e9a8f0a5a4d1131330', 'request_id': 'req-3cd97c54-b4ce-4b2f-affb-2681d73c31db'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.290722 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] The token cache is being invalidate because project 44d9d4188a9149e9a8f0a5a4d1131330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:11.291176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.292166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.297531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1301/2636] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:10 2022] DELETE /identity/v3/projects/44d9d4188a9149e9a8f0a5a4d1131330 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:11.299467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:11.326420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725af88-97c7-4f01-8830-e0ae1c4f95d4 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:11.387259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:11.415124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:11.416174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:11.416463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:11.416815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] PATH_INFO: `/v3/users/165a8afd791b4363994e659e017d7546` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:11.418463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165a8afd791b4363994e659e017d7546)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:11.420476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:11.823694 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165a8afd791b4363994e659e017d7546'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.920978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165a8afd791b4363994e659e017d7546'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.921770 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165a8afd791b4363994e659e017d7546'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.943166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165a8afd791b4363994e659e017d7546'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.958403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b4b9e8f5-5f18-4159-8ce0-85f36448b6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165a8afd791b4363994e659e017d7546'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:11.970185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1336/2637] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:11 2022] DELETE /identity/v3/users/165a8afd791b4363994e659e017d7546 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:12.714128 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:12.717044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:12.733389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97c54-b4ce-4b2f-affb-2681d73c31db admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:12.838247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:12.839116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:12.839901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:12.839901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] PATH_INFO: `/v3/projects/5a162bd04a224c12bbf0de372d34767d` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:12.841415 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a162bd04a224c12bbf0de372d34767d)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:12.843744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.021195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a162bd04a224c12bbf0de372d34767d', 'request_id': 'req-7187047a-f1af-451e-a967-7da185a050b2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:13.027860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.028782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.028965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.051446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:13.052752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:13.119914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1337/2638] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:13.132500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a162bd04a224c12bbf0de372d34767d', 'request_id': 'req-7187047a-f1af-451e-a967-7da185a050b2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:13.137259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:13.143331 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:13.143487 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a162bd04a224c12bbf0de372d34767d', 'request_id': 'req-7187047a-f1af-451e-a967-7da185a050b2'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:13.155237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] The token cache is being invalidate because project 5a162bd04a224c12bbf0de372d34767d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:13.155697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:13.156555 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7187047a-f1af-451e-a967-7da185a050b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:13.158373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1302/2639] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:12 2022] DELETE /identity/v3/projects/5a162bd04a224c12bbf0de372d34767d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:13.167011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.167351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.167715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.198784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:13.201212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:13.230739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd565a38-b6d3-40cb-b047-70c35a961b4c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:13.235404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:13.238557 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:13.239319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.239705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.240045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.243451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:13.253487 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:13.259362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:13.262273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacfbf3-daa7-4afd-95c8-68a7f7bf26ec service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.274740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1338/2640] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:17:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:17:13.281721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1303/2641] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:13.290444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.290803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.291082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.314387 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:13.315671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:13.325504 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1339/2642] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:13.330071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:13.342288 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea992d-928a-48e1-bafc-41b279cdab0e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:13.347653 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:13.348499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.348976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.352405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.352405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:13.352405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:13.352405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.366123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1304/2643] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:17:13.372667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:13.384316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f35d-cede-4801-8d13-fd7a130b94ac None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:13.389877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:13.390520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.390807 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.391085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.391761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:13.393898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.554737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1340/2644] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:13.556180 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:13.578089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe50ca-d430-4bfd-a1ff-5798ee6b42bd admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:13.717789 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:13.720785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.722352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.723085 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.724626 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:13.728989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.895275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1305/2645] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:13 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:13.902335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:13.931546 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93955e1-981b-4464-b76b-b04693b5a4b7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:13.947305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:13.949214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:13.950875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:13.950875 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:13.952204 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:13.958437 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:13.994799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1341/2646] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:13.995903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:14.015995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7674e-1ce6-4d1b-848d-8983c57930de admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:14.030864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:14.032409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:14.037129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:14.040310 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:14.042598 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:14.045902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08a63f-de02-4bcf-b93c-a8ba4ec06bdb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:14.080757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1306/2647] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:14.092786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:14.120913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c831-3b1d-4d8d-b07e-c333162e63d0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:14.132856 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:14.134688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:14.135960 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:14.137060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] PATH_INFO: `/v3/projects/b24d0b9b8f6a494bab9958898502f4c2/users/324e98e0639840ad99beed0031b477fe/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:14.164707 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24d0b9b8f6a494bab9958898502f4c2, user_id=324e98e0639840ad99beed0031b477fe, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:14.168277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:14.276648 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1342/2648] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:14 2022] PUT /identity/v3/projects/b24d0b9b8f6a494bab9958898502f4c2/users/324e98e0639840ad99beed0031b477fe/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:14.290743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:14.291660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:14.292346 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:14.362561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] MFA Rules not processed for user `324e98e0639840ad99beed0031b477fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:14.368705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:14.568309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1307/2649] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:14.576107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:14.714183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579d25-79fa-49d0-835e-a4df0f1299e6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:14.721361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:14.722605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:14.722902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:14.723292 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:14.724397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:14.728426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:14.996074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1343/2650] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:14 2022] POST /identity/v3/projects => generated 383 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:15.001396 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:15.031792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507278-d143-4440-a471-6a1a684c6064 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:15.088255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:15.145471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:15.146333 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.146727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.147129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.149100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:15.152363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:15.309705 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1308/2651] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:14 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:15.316315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:15.346369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0333c-b8ee-4667-b685-363e75f4b0af admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:15.357360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:15.358441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.358932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.359436 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.360712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:15.364416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:15.413677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:15.420322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1344/2652] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:17:15.439289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7f4a6-67c0-4723-9dae-77138fc4adc3 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:15.446927 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:15.448582 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.449326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.450477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] PATH_INFO: `/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc/users/c23d213116a140688f9272ed561ccbd6/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.481655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f199e4dfe4cb4dcd873c51c0a97ae9cc, user_id=c23d213116a140688f9272ed561ccbd6, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:15.486392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:15.589730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1309/2653] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:15 2022] PUT /identity/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc/users/c23d213116a140688f9272ed561ccbd6/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:15.597905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:15.622120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132640f-2bbd-45e4-90a3-31ab745c739c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:15.748538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:15.749366 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.753117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.753117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.753117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:15.753117 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f4881-2af5-47fd-81f0-abe6fb45944c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:15.762153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:15.777166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:15.777461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1345/2654] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:15.790891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f40146-b577-4a40-abaf-01b9adac762a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:15.797241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:15.798071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.798473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.798834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] PATH_INFO: `/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc/users/c23d213116a140688f9272ed561ccbd6/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.801773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f199e4dfe4cb4dcd873c51c0a97ae9cc, user_id=c23d213116a140688f9272ed561ccbd6, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:15.805187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:15.829185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1310/2655] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:15 2022] PUT /identity/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc/users/c23d213116a140688f9272ed561ccbd6/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:15.851874 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:15.852569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:15.853014 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:15.938035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] MFA Rules not processed for user `c23d213116a140688f9272ed561ccbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:15.940284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:16.082906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1346/2656] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:16.103226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:16.107108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:16.232264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576555c-41d0-44b7-8c98-416c6e37598b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:16.240643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:16.240643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:16.240643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:16.240643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:16.253028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:16.255312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:16.287665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1311/2657] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:16.416400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:16.418108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:16.519136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:16.522532 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899ea2-2677-49cb-89c8-e998a74e0128 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:16.539734 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b713c-0833-4cb2-907c-97ac902ecfd9 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:16.546459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:16.549097 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:16.550307 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:16.551039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:16.551788 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] PATH_INFO: `/v3/users/a7589fa2882e4c9c972f17fdce685def` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:16.552875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:16.553482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:16.554199 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:16.556626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7589fa2882e4c9c972f17fdce685def)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:16.563308 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:16.689960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:16.699797 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25b6d5-2ed1-48aa-be37-06de7bd893fe service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:16.712429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1312/2658] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:16.843605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7589fa2882e4c9c972f17fdce685def'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:16.949376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7589fa2882e4c9c972f17fdce685def'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:16.950460 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7589fa2882e4c9c972f17fdce685def'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:17.002373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7589fa2882e4c9c972f17fdce685def'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:17.041163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7589fa2882e4c9c972f17fdce685def'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:17.068197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1347/2659] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:16 2022] DELETE /identity/v3/users/a7589fa2882e4c9c972f17fdce685def => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:17.075772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:17.080769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:17.080769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:17.116419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:17.121065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:17.158152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:17.254224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1313/2660] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:17.275870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:17.275870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:17.283641 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:17.398517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506b26-7d3d-4059-a0d4-c9e5a49d8872 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:17.411086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:17.411086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:17.411086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:17.411086 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:17.421841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:17.424896 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372537d0-ac43-4b5c-bc4a-4282a47d4d25 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:17.444263 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1348/2661] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:17.562764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:17.564807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:17.590504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc907345-17c8-49c1-9088-cc16328b2eb5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:17.602893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:17.604581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:17.605355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:17.606558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] PATH_INFO: `/v3/users/324e98e0639840ad99beed0031b477fe` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:17.611974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324e98e0639840ad99beed0031b477fe)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:17.617770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:17.905845 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324e98e0639840ad99beed0031b477fe'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.013368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324e98e0639840ad99beed0031b477fe'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.015271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324e98e0639840ad99beed0031b477fe'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.030244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324e98e0639840ad99beed0031b477fe'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.071056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324e98e0639840ad99beed0031b477fe'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.102550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1314/2662] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:17 2022] DELETE /identity/v3/users/324e98e0639840ad99beed0031b477fe => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:18.102859 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:18.103049 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:18.103329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:18.153475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:18.162437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:18.193347 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:18.201583 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:18.380880 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008e16-b6c5-4fe0-84fd-8970a05a5ca6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:18.381580 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1349/2663] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:18.393891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:18.395466 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:18.395913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:18.396710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] PATH_INFO: `/v3/projects/b5ad0f247a4a4f269437785d586f5130` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:18.401356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:18.407131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:18.410019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ad0f247a4a4f269437785d586f5130)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:18.432220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:18.579910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1d2f-9a4b-4ba0-97ad-d3c7b53f1a1d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:18.594085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:18.595676 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:18.597191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:18.604136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:18.621647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:18.623237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:18.625217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:18.646816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1350/2664] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:18.649910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ad0f247a4a4f269437785d586f5130', 'request_id': 'req-e79d8e2f-f183-4e4e-969c-323a5d95a31d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.761537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ad0f247a4a4f269437785d586f5130', 'request_id': 'req-e79d8e2f-f183-4e4e-969c-323a5d95a31d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.781136 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ad0f247a4a4f269437785d586f5130', 'request_id': 'req-e79d8e2f-f183-4e4e-969c-323a5d95a31d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.826809 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] The token cache is being invalidate because project b5ad0f247a4a4f269437785d586f5130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:18.827680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.829198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:18.832129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1315/2665] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:18 2022] DELETE /identity/v3/projects/b5ad0f247a4a4f269437785d586f5130 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:18.838446 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:18.871597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d42f-ff24-4145-a14c-c35aa2b730e4 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:18.974510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:18.987451 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:18.988637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:18.989184 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:18.989716 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] PATH_INFO: `/v3/users/0a2e264a166d46a18cc6346cb558c51c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:18.992736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2e264a166d46a18cc6346cb558c51c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:18.997008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:19.407255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2e264a166d46a18cc6346cb558c51c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.459931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:19.463990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:19.494692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d8e2f-f183-4e4e-969c-323a5d95a31d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:19.500808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:19.501769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:19.502129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:19.502502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] PATH_INFO: `/v3/projects/b24d0b9b8f6a494bab9958898502f4c2` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:19.504232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24d0b9b8f6a494bab9958898502f4c2)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:19.506629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:19.515221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2e264a166d46a18cc6346cb558c51c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.516079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2e264a166d46a18cc6346cb558c51c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.546618 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2e264a166d46a18cc6346cb558c51c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.579778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2e264a166d46a18cc6346cb558c51c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.591552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1351/2666] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:18 2022] DELETE /identity/v3/users/0a2e264a166d46a18cc6346cb558c51c => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:19.737881 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24d0b9b8f6a494bab9958898502f4c2', 'request_id': 'req-1c25ca10-25c4-46bd-8f62-369109b9d9f9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.864249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24d0b9b8f6a494bab9958898502f4c2', 'request_id': 'req-1c25ca10-25c4-46bd-8f62-369109b9d9f9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.874285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24d0b9b8f6a494bab9958898502f4c2', 'request_id': 'req-1c25ca10-25c4-46bd-8f62-369109b9d9f9'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.906400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] The token cache is being invalidate because project b24d0b9b8f6a494bab9958898502f4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:19.906857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.907737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:19.909746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1316/2667] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:19 2022] DELETE /identity/v3/projects/b24d0b9b8f6a494bab9958898502f4c2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:19.916432 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:19.920357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:20.048136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20d3b6-2aa1-452f-9947-2389d459f343 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:20.229656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:20.230438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:20.230808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:20.231095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] PATH_INFO: `/v3/users/c23d213116a140688f9272ed561ccbd6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:20.232775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23d213116a140688f9272ed561ccbd6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:20.234952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:20.273511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:20.528456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23d213116a140688f9272ed561ccbd6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.560997 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:20.564253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:20.602143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ca10-25c4-46bd-8f62-369109b9d9f9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:20.607615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:20.608414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:20.608776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:20.609053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] PATH_INFO: `/v3/projects/d795193f94a145219ca26fdce9f4662e` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:20.611690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d795193f94a145219ca26fdce9f4662e)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:20.613697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:20.619719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23d213116a140688f9272ed561ccbd6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.621034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23d213116a140688f9272ed561ccbd6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.644456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23d213116a140688f9272ed561ccbd6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.657509 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c1d93a4a-e2ba-4b83-ad6b-b5ef702a8ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23d213116a140688f9272ed561ccbd6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.670276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1352/2668] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:19 2022] DELETE /identity/v3/users/c23d213116a140688f9272ed561ccbd6 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:20.789616 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd795193f94a145219ca26fdce9f4662e', 'request_id': 'req-7a98404a-9d3d-4190-b864-a6d8779af90d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.887158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd795193f94a145219ca26fdce9f4662e', 'request_id': 'req-7a98404a-9d3d-4190-b864-a6d8779af90d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.897230 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd795193f94a145219ca26fdce9f4662e', 'request_id': 'req-7a98404a-9d3d-4190-b864-a6d8779af90d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.935597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] The token cache is being invalidate because project d795193f94a145219ca26fdce9f4662e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:20.936205 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.937511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7a98404a-9d3d-4190-b864-a6d8779af90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:20.952697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:20.953211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:20.953704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:20.960391 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1317/2669] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:20 2022] DELETE /identity/v3/projects/d795193f94a145219ca26fdce9f4662e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:21.046555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:21.049062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:21.215368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1353/2670] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:21.235917 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:21.236432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:21.236977 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:21.296965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:21.296965 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:21.323089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1318/2671] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:21.328974 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:21.348771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707ba16-d99f-4b3c-a85b-03adf377d1fe None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:21.357654 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:21.359285 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:21.360220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:21.361141 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:21.362440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:21.363306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:21.365995 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:21.387239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1354/2672] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:17:21.391962 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:21.410208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdb4b4-c28b-494b-ba09-8901ca7b1a41 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:21.415763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:21.442951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:21.442951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:21.442951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:21.442951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:21.442951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:21.884399 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:21.886314 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:21.914444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e30e-71f7-4024-a7e4-cb6a7fafdf6b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:21.941584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:21.941584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:21.941584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:21.941584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] PATH_INFO: `/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:21.942466 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f199e4dfe4cb4dcd873c51c0a97ae9cc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:21.944543 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.006897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1319/2673] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:21 2022] POST /identity/v3/projects => generated 373 bytes in 615 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:17:22.008987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.020183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=78,keystone:DELETE=18,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:22.129916 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f199e4dfe4cb4dcd873c51c0a97ae9cc', 'request_id': 'req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:22.153244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217b8b-6e5d-4720-84af-67eb718235a5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.235555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f199e4dfe4cb4dcd873c51c0a97ae9cc', 'request_id': 'req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:22.248350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f199e4dfe4cb4dcd873c51c0a97ae9cc', 'request_id': 'req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:22.272501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] The token cache is being invalidate because project f199e4dfe4cb4dcd873c51c0a97ae9cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:22.273823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:22.277162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-91afcdd4-8e6a-4f83-9a50-b72ef09107cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:22.280323 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1355/2674] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:21 2022] DELETE /identity/v3/projects/f199e4dfe4cb4dcd873c51c0a97ae9cc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:22.282524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.284102 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.285884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.286895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.288478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.291153 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0072a-b370-404b-a148-4ce5463fe10e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.291709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0072a-b370-404b-a148-4ce5463fe10e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.292371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0072a-b370-404b-a148-4ce5463fe10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.296086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.325831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:22.339231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0fe0072a-b370-404b-a148-4ce5463fe10e None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:22.342994 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0fe0072a-b370-404b-a148-4ce5463fe10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:22.353964 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1356/2675] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:22.373036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.373402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.373920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.410267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:22.412811 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:22.433233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1320/2676] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:22 2022] POST /identity/v3/users => generated 287 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:22.439742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.443247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1357/2677] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:22.448594 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:22.450799 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.470162 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6541-2659-4d67-bd60-152c563f4aaa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.488441 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.489484 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.489743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a4664-034f-49cf-a7d0-2f0ca71b8e95 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.489985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.490370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.492108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:22.498333 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.498836 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.504209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.510610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.510610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.510610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.510610 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.512486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.526370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1358/2678] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:17:22.527925 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.547172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9250c-5a4d-4168-9016-60540ab43b9d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.555299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.556782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.557336 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.557941 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.558839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.560227 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1321/2679] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:22.562458 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.567147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.596412 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd52c-01ad-437c-a3d6-7f8ef28ec880 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.609887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.611747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.612671 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.613515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.615323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.621501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.650080 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1322/2680] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:22.655850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.681170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1359/2681] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:22 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:22.683473 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7523c0-6381-4cc1-b9c1-01531f84068e admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.686358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:22.833698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.834751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.835001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.835281 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] PATH_INFO: `/v3/projects/88c6242740a6441eb5110008cb1682c2/users/9644acaf97ad4647b94626c37a8bd00b/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.872008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5177f1-de15-44d5-b9ad-e7d0a2342c52 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:22.886669 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:22.888479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c6242740a6441eb5110008cb1682c2, user_id=9644acaf97ad4647b94626c37a8bd00b, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.891223 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:22.891621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:22.891886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:22.892777 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:22.894194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea000e0-7494-477b-aabc-351c3e36915a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:22.897211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:23.020575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:23.034887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1323/2682] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:22 2022] PUT /identity/v3/projects/88c6242740a6441eb5110008cb1682c2/users/9644acaf97ad4647b94626c37a8bd00b/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:23.044892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.045627 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.046087 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.057329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1360/2683] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:22 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:23.058893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:23.072095 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab850f-29a1-4ff9-9546-ab040b2b9aeb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:23.093131 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:23.094076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:23.250389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:23.250389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.250389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.250389 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.252756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:23.252756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:23.252756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1361/2684] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:23.253282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1324/2685] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:23.254740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:23.263066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:23.264935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:23.267705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a140f2-0384-4ee6-a230-072a11a4af07 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:23.274697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:23.275513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.276106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.276493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.277809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:23.279905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:23.299771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1362/2686] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:23.300967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:23.313889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb536e-a720-4108-9942-a4a1eb0db98f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:23.319075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:23.320415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.320891 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.321179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] PATH_INFO: `/v3/projects/c24ff154fbdc4fc4a4e6f114991681d3/users/b62d50776db34a99ae5d518183a79d7c/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.342412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24ff154fbdc4fc4a4e6f114991681d3, user_id=b62d50776db34a99ae5d518183a79d7c, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:23.345782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:23.393782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba515a-8b7b-468d-bb49-7173afe5437f None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:23.403060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:23.404127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.404748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.405318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.423053 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:23.425700 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe4b13-6fd9-4e35-902f-505026fa019c service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:23.441779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1325/2687] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:23.799352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1363/2688] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:23 2022] PUT /identity/v3/projects/c24ff154fbdc4fc4a4e6f114991681d3/users/b62d50776db34a99ae5d518183a79d7c/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:23.818560 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:23.819032 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:23.819553 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:23.862434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] MFA Rules not processed for user `b62d50776db34a99ae5d518183a79d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:23.864409 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:23.964783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1326/2689] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:23.978192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:23.980957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:24.003842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:24.112170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a57a4-b99c-4170-891d-eb27451b615c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:24.122375 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:24.127899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:24.127899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:24.127899 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:24.144442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:24.150968 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc557d1-f121-40b1-9e78-8c0affb1efc0 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:24.172715 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1364/2690] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:24.204122 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:24.258443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=100 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:24.299058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c35c09-b2ff-4728-a993-e3041316900e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:24.305278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:24.305979 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:24.306261 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:24.306533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] PATH_INFO: `/v3/users/b62d50776db34a99ae5d518183a79d7c` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:24.307800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62d50776db34a99ae5d518183a79d7c)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:24.309778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:24.561849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62d50776db34a99ae5d518183a79d7c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:24.669496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62d50776db34a99ae5d518183a79d7c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:24.670835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62d50776db34a99ae5d518183a79d7c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:24.682815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62d50776db34a99ae5d518183a79d7c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:24.703968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62d50776db34a99ae5d518183a79d7c'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:24.716355 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1327/2691] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:24 2022] DELETE /identity/v3/users/b62d50776db34a99ae5d518183a79d7c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:17:24.723181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfaac0-37b4-48e7-862e-d1c3d0e666f1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:24.723717 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfaac0-37b4-48e7-862e-d1c3d0e666f1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:24.724303 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfaac0-37b4-48e7-862e-d1c3d0e666f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:24.758403 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bccfaac0-37b4-48e7-862e-d1c3d0e666f1 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:24.760710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bccfaac0-37b4-48e7-862e-d1c3d0e666f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:24.881229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1365/2692] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:24.897178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:24.899892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:24.985783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a2-b2f5-43e8-b2aa-589a5172b9ca admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:24.990538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:24.995933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:24.995933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:24.995933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:25.006759 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:25.009990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:25.023951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1328/2693] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:25.682384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:25.682384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:25.682384 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:25.739838 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] MFA Rules not processed for user `9644acaf97ad4647b94626c37a8bd00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:25.742260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:25.851068 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1366/2694] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:25.866009 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:25.869518 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:25.873987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:25.876653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:25.891082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae7e76-8273-4a5a-90ca-a65a9e89e431 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:25.899006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:25.899863 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:25.900279 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:25.900785 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] PATH_INFO: `/v3/projects/c24ff154fbdc4fc4a4e6f114991681d3` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:25.903247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24ff154fbdc4fc4a4e6f114991681d3)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:25.907360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:25.967599 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:25.986428 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6b1db-f910-4d41-b2c3-f8568f0cc87d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:25.992985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:25.993930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:25.994354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:25.994763 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.010465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.013442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f35dd-953c-4c54-8467-7bddde4bc71d service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:26.031085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1367/2695] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:26.079245 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24ff154fbdc4fc4a4e6f114991681d3', 'request_id': 'req-714bef52-8e88-4b4a-80b3-d4a12caaad1f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:26.082483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:26.201064 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24ff154fbdc4fc4a4e6f114991681d3', 'request_id': 'req-714bef52-8e88-4b4a-80b3-d4a12caaad1f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:26.208071 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24ff154fbdc4fc4a4e6f114991681d3', 'request_id': 'req-714bef52-8e88-4b4a-80b3-d4a12caaad1f'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:26.221936 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] The token cache is being invalidate because project c24ff154fbdc4fc4a4e6f114991681d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:26.222232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:26.223000 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-714bef52-8e88-4b4a-80b3-d4a12caaad1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:26.224632 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1329/2696] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:25 2022] DELETE /identity/v3/projects/c24ff154fbdc4fc4a4e6f114991681d3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:26.231688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.232063 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.232400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.255820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:26.258004 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:26.342206 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1368/2697] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:17:26.350901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.352038 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.352471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.384357 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:26.386356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:26.396392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1330/2698] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:26.401756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:26.413196 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266140-c4ee-4280-ba34-4d4293f65bf2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:26.419610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.433541 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:26.439743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1369/2699] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:17:26.445086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:26.456660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf38165-7042-4ad2-94f5-f3f3e859e6db None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:26.462012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:26.462699 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.462974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.463247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.463914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.465888 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:26.672540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1331/2700] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:17:26 2022] POST /identity/v3/projects => generated 391 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:26.680775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:26.694485 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e11f2c-1273-42a4-bcbd-9ab151e078ed admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:26.800985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:26.801917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.802342 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.802844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.803689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.806932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:26.907984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1370/2701] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:17:26 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:17:26.911123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:26.926801 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32189-02ce-4878-adff-b40cd43c8b25 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:26.945643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:26.947067 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.947692 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.948177 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.949479 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.953222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:26.969197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1332/2702] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:17:26.973905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:26.988862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1402cf-6193-445f-b4c7-e4e3f2e34061 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:26.992536 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:26.993252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:26.993610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:26.993947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:26.994768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:26.996538 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcd651-dc7a-410b-9471-b5ddf0a3bee4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:27.008982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1371/2703] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:17:27.013664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:27.025554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9c179-cfc9-441f-8066-810718826fe7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:27.030735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:27.031515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:27.031800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:27.032084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] PATH_INFO: `/v3/projects/019bcbb5b1f247e394fb0fac2fb12b22/users/607ce9033dc5431abd16f072518d965e/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:27.049756 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019bcbb5b1f247e394fb0fac2fb12b22, user_id=607ce9033dc5431abd16f072518d965e, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:27.052608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:27.236151 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1333/2704] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:17:27 2022] PUT /identity/v3/projects/019bcbb5b1f247e394fb0fac2fb12b22/users/607ce9033dc5431abd16f072518d965e/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:27.248227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774353e-f018-4a73-aa15-5bfdcb6cc868 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:27.248547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774353e-f018-4a73-aa15-5bfdcb6cc868 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:27.248839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774353e-f018-4a73-aa15-5bfdcb6cc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:27.291017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2774353e-f018-4a73-aa15-5bfdcb6cc868 None None] MFA Rules not processed for user `607ce9033dc5431abd16f072518d965e`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:27.292280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2774353e-f018-4a73-aa15-5bfdcb6cc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:27.351282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:27.405343 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1372/2705] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:27.418217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:27.420416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:27.498812 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6a96-3f2e-4e78-ab8d-4e445e38d460 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:27.504909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:27.506004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:27.506537 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:27.507070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:27.521326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:27.523400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:27.534142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1334/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:29.239679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560378-4e53-47b2-9cd6-5fcb1290a729 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:29.240377 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560378-4e53-47b2-9cd6-5fcb1290a729 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:29.240823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560378-4e53-47b2-9cd6-5fcb1290a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:29.265279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8c560378-4e53-47b2-9cd6-5fcb1290a729 None None] MFA Rules not processed for user `9644acaf97ad4647b94626c37a8bd00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:29.266547 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8c560378-4e53-47b2-9cd6-5fcb1290a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:29.348584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1373/2707] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:29.701682 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:29.703755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:29.774126 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89057d2-137b-4e36-badf-d51de2ec1e37 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:29.778407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:29.779054 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:29.779334 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:29.779622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:29.781689 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:29.799711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:29.802641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:29.815197 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1335/2708] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:32.053233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:32.054572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:32.054572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:32.090157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:32.091852 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:32.206005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1374/2709] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:32.224068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:32.225871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:32.269302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:32.381023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595effb-12d2-4a23-9c3b-20ff120a8c1e service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:32.393282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:32.393282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:32.393282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:32.393282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:32.411596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:32.413375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:32.447710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1336/2710] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:17:40.354659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:40.372368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6a93-2940-4bc2-aaa0-81b5d59c7038 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:40.377512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:40.378163 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:40.378444 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:40.378748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:40.380865 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:40.458246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:40.459787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44af83c-066e-410e-a360-7eb74ea97ce7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:40.471854 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1375/2711] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:42.800015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:42.824380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01144f-b447-4d77-aa60-63afcbf0c643 service swift] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:42.862271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:42.863618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:42.864133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:42.864771 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] PATH_INFO: `/v3/users/607ce9033dc5431abd16f072518d965e` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:42.868044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=607ce9033dc5431abd16f072518d965e)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:42.872940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:43.129685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607ce9033dc5431abd16f072518d965e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:43.268874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607ce9033dc5431abd16f072518d965e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:43.269721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607ce9033dc5431abd16f072518d965e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:43.282198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607ce9033dc5431abd16f072518d965e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:43.301394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607ce9033dc5431abd16f072518d965e'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:43.318723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1337/2712] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:42 2022] DELETE /identity/v3/users/607ce9033dc5431abd16f072518d965e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:43.328059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:43.331574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:43.331882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:43.397271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:43.399984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:43.426309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:43.515398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1376/2713] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:17:43.529485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:43.531580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:43.642723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8e3bf-d206-4205-b73a-5fb4eec5f4dc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:43.650047 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:43.651120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:43.651824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:43.652198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:43.671414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:43.673325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:43.693766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1338/2714] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:17:44.436001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:44.438622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:44.467876 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de58b98-a429-4bb1-9fa8-6ee80817ff75 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:44.477671 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:44.479201 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:44.479692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:44.480189 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] PATH_INFO: `/v3/projects/019bcbb5b1f247e394fb0fac2fb12b22` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:44.482341 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019bcbb5b1f247e394fb0fac2fb12b22)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:44.486600 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:44.683198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019bcbb5b1f247e394fb0fac2fb12b22', 'request_id': 'req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:44.818402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019bcbb5b1f247e394fb0fac2fb12b22', 'request_id': 'req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:44.826915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019bcbb5b1f247e394fb0fac2fb12b22', 'request_id': 'req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:44.840992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] The token cache is being invalidate because project 019bcbb5b1f247e394fb0fac2fb12b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:44.841280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:44.841962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:44.843523 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1377/2715] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:44 2022] DELETE /identity/v3/projects/019bcbb5b1f247e394fb0fac2fb12b22 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:51.295401 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:51.298158 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:51.336027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3e48d-1f8b-4c00-9bc9-43d41969c5ff service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:51.368110 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:51.429243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:51.439906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:51.439906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:51.439906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] PATH_INFO: `/v3/users/711396a88956426c9eb554f518230a8a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:51.439906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=711396a88956426c9eb554f518230a8a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:51.439906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:51.705024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711396a88956426c9eb554f518230a8a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:51.823155 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711396a88956426c9eb554f518230a8a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:51.825720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711396a88956426c9eb554f518230a8a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:51.834420 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711396a88956426c9eb554f518230a8a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:51.859707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711396a88956426c9eb554f518230a8a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:51.872072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1339/2716] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:51 2022] DELETE /identity/v3/users/711396a88956426c9eb554f518230a8a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:52.221514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:52.224491 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:52.246179 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85dae-4c70-4bf6-afc8-8a1a11a73e70 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:52.321663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:52.322412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:52.322755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:52.323079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] PATH_INFO: `/v3/projects/7b3d5ff6a3d14833874b090af2d5c090` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:52.324370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3d5ff6a3d14833874b090af2d5c090)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:52.326663 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:52.455744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:52.462855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3d5ff6a3d14833874b090af2d5c090', 'request_id': 'req-9763f733-9212-47b6-8cb8-f04e791aa550'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:52.570516 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3d5ff6a3d14833874b090af2d5c090', 'request_id': 'req-9763f733-9212-47b6-8cb8-f04e791aa550'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:52.578295 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3d5ff6a3d14833874b090af2d5c090', 'request_id': 'req-9763f733-9212-47b6-8cb8-f04e791aa550'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:52.591851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] The token cache is being invalidate because project 7b3d5ff6a3d14833874b090af2d5c090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:52.592154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:52.592830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:52.594417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1378/2717] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:52 2022] DELETE /identity/v3/projects/7b3d5ff6a3d14833874b090af2d5c090 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:52.598664 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:52.600147 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:52.613568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0a54-5800-4a84-ba72-88fb29f596ec admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:52.680982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:52.681779 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:52.682150 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:52.682520 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] PATH_INFO: `/v3/users/31265c8659b34073846d77e80d7fedc1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:52.683928 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31265c8659b34073846d77e80d7fedc1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:52.686029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:52.975777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:52.978581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31265c8659b34073846d77e80d7fedc1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.087462 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31265c8659b34073846d77e80d7fedc1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.088753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31265c8659b34073846d77e80d7fedc1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.102331 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31265c8659b34073846d77e80d7fedc1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.124265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-2f900bea-da9b-4b4d-a007-613f0e78e027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31265c8659b34073846d77e80d7fedc1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.140259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1340/2718] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:17:52 2022] DELETE /identity/v3/users/31265c8659b34073846d77e80d7fedc1 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:53.532058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:53.535106 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:53.561511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763f733-9212-47b6-8cb8-f04e791aa550 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:53.676031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:53.677289 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:53.677766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:53.678255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] PATH_INFO: `/v3/projects/82322ca9fc00485aafb194157bb1985d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:53.681858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82322ca9fc00485aafb194157bb1985d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:53.685818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:53.871414 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82322ca9fc00485aafb194157bb1985d', 'request_id': 'req-4895e16d-f9e8-4259-8dec-0582cd2e9f93'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.966152 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82322ca9fc00485aafb194157bb1985d', 'request_id': 'req-4895e16d-f9e8-4259-8dec-0582cd2e9f93'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:53.974808 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82322ca9fc00485aafb194157bb1985d', 'request_id': 'req-4895e16d-f9e8-4259-8dec-0582cd2e9f93'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:54.001083 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] The token cache is being invalidate because project 82322ca9fc00485aafb194157bb1985d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:17:54.001597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:54.002820 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:17:54.006752 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1379/2719] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:17:53 2022] DELETE /identity/v3/projects/82322ca9fc00485aafb194157bb1985d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:17:55.941566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafdc13-7590-457b-a77d-7e31ca86e2fa None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:55.941566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafdc13-7590-457b-a77d-7e31ca86e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:55.941566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafdc13-7590-457b-a77d-7e31ca86e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:55.963638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6dafdc13-7590-457b-a77d-7e31ca86e2fa None None] MFA Rules not processed for user `9644acaf97ad4647b94626c37a8bd00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:17:55.964933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6dafdc13-7590-457b-a77d-7e31ca86e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:56.031819 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1341/2720] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:03.992477 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:06.024121 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=38,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:16.559473 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:16.561877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:16.770235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895e16d-f9e8-4259-8dec-0582cd2e9f93 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:16.779317 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:16.779983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:16.784741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:16.785797 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:16.788736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:16.808382 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:16.813215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:16.836998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1380/2721] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:18:21.735893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27065a-9d45-4ff5-8a57-2fc4b72460ad None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:21.736764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27065a-9d45-4ff5-8a57-2fc4b72460ad None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:21.736764 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27065a-9d45-4ff5-8a57-2fc4b72460ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:21.760822 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-5c27065a-9d45-4ff5-8a57-2fc4b72460ad None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:21.762084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5c27065a-9d45-4ff5-8a57-2fc4b72460ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:21.855628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1342/2722] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:18:21.886156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:21.887652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:21.993743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084fc5-d4b8-4375-852a-8ff37b1191e7 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:22.002625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:22.003639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:22.004100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:22.004611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:22.021328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:22.026060 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b96fbb-56c9-49ca-926f-66eedd293082 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:22.043250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1381/2723] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:18:23.384260 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:23.385545 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:23.386267 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:23.410441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] MFA Rules not processed for user `544278669a2d4884bcfc7c2f7dbff624`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:23.412062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:23.544715 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1343/2724] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:32.035913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=73 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:33.530394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=50 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:42.917796 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:42.921396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:42.921396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:42.944607 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:42.946057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:42.955858 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1382/2725] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:42.973052 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:42.985869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933460b-b64e-4486-bc04-4214934c6f17 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:42.991581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:42.992259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:42.992629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:42.992947 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:43.005873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:43.010723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:43.038048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1344/2726] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:18:47.171743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:47.175335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:47.262787 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa339d3f-0a4f-4794-9267-261fc80e6176 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:47.267844 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:47.268633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:47.268954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:47.269234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] PATH_INFO: `/v3/users/9644acaf97ad4647b94626c37a8bd00b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:47.270550 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9644acaf97ad4647b94626c37a8bd00b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:47.273391 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:47.590102 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9644acaf97ad4647b94626c37a8bd00b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:47.680565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9644acaf97ad4647b94626c37a8bd00b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:47.681355 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9644acaf97ad4647b94626c37a8bd00b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:47.699660 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9644acaf97ad4647b94626c37a8bd00b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:47.707992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cc6a33b3-8ce2-4bff-9733-4db1abfb96c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9644acaf97ad4647b94626c37a8bd00b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:47.715885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1383/2727] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:18:47 2022] DELETE /identity/v3/users/9644acaf97ad4647b94626c37a8bd00b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:18:48.052057 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:48.064906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69372681-0276-4769-9475-904fa90f2a4e service swift] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:48.149540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:48.150506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.151021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.151508 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] PATH_INFO: `/v3/projects/88c6242740a6441eb5110008cb1682c2` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.153694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c6242740a6441eb5110008cb1682c2)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:48.157489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:48.342452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c6242740a6441eb5110008cb1682c2', 'request_id': 'req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:48.457681 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c6242740a6441eb5110008cb1682c2', 'request_id': 'req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:48.469649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c6242740a6441eb5110008cb1682c2', 'request_id': 'req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:48.492296 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] The token cache is being invalidate because project 88c6242740a6441eb5110008cb1682c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:18:48.492879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:48.494018 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-41457172-f2a3-42a9-b3c9-2e7f9fe4656d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:18:48.496737 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1345/2728] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:18:48 2022] DELETE /identity/v3/projects/88c6242740a6441eb5110008cb1682c2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:18:48.503582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.504154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.504154 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.527905 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:48.529337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:48.602239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1384/2729] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:48.610237 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.610524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.610808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.634123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:48.635378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:48.643680 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1346/2730] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:18:48.648866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:48.659412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eab53e-54a2-455b-b2ad-34f22a509cbc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:48.666224 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:48.666910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.667219 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.667493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.668157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:18:48.668462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:48.670121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:48.680961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:48.684623 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1385/2731] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:18:48.691200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:48.704783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1434-44b9-4441-9933-0949d8b55dd7 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:48.713328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:48.714264 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.714749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.715215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.716405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:48.720157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:48.842678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1347/2732] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:18:48 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:18:48.847306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:48.859609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd4f8-03ae-48c0-adfc-df2e56aeadd0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:48.933417 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:48.934022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:48.934302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:48.934574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:48.935240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:48.937251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:49.063849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1386/2733] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:18:48 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:18:49.071402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:49.083607 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a7297-dcfb-495e-bc1f-0cedf2389c8b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:49.091543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:49.092685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:49.093193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:49.093673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:49.094982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:49.098253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:49.123891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1348/2734] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:18:49.128360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:49.141482 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62c2b2-01ec-4379-a11b-afa10f50564c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:49.147967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:49.148930 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:49.149277 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:49.149597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:49.150386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:49.152099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc92e-ce48-420b-bfc1-df80f94be052 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:49.165440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1387/2735] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:18:49.170283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:49.183002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b0b2-d56a-453d-84c8-8c62418ddd8a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:49.188583 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:49.192323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:49.192323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:49.192323 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] PATH_INFO: `/v3/projects/b0d60f4cce754c8bb6a3baa7f552bdfc/users/c67c70aa2eb64f72bd15437958a8480d/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:49.210379 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d60f4cce754c8bb6a3baa7f552bdfc, user_id=c67c70aa2eb64f72bd15437958a8480d, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:49.213422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:49.365365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1349/2736] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:18:49 2022] PUT /identity/v3/projects/b0d60f4cce754c8bb6a3baa7f552bdfc/users/c67c70aa2eb64f72bd15437958a8480d/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:18:49.438085 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:49.438386 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:49.438629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:49.481023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] MFA Rules not processed for user `c67c70aa2eb64f72bd15437958a8480d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:49.482356 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:49.558041 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1388/2737] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:49.576394 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:18:49.579427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:49.601092 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:49.651141 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f124-3499-426b-afa8-6f9cba2e7c10 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:18:49.655035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:18:49.661670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:49.661670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:49.661670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:49.666898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:18:49.668361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b755-e3f5-4912-91c7-f7523835d0b4 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:18:49.683255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1350/2738] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:18:59.554672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:59.723468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=20 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:06.380227 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:06.482803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347e240-7dd8-4d09-bd0e-9442d809ec9f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:06.490211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:06.492147 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:06.492661 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:06.493134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] PATH_INFO: `/v3/users/c67c70aa2eb64f72bd15437958a8480d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:06.495280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67c70aa2eb64f72bd15437958a8480d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:06.498845 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:06.766622 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67c70aa2eb64f72bd15437958a8480d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:06.898502 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67c70aa2eb64f72bd15437958a8480d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:06.899362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67c70aa2eb64f72bd15437958a8480d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:06.916150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67c70aa2eb64f72bd15437958a8480d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:06.925267 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67c70aa2eb64f72bd15437958a8480d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:06.934183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1389/2739] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:19:06 2022] DELETE /identity/v3/users/c67c70aa2eb64f72bd15437958a8480d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:19:06.939460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:06.940129 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:06.940306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:06.962857 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:06.964134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:07.047741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1351/2740] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:19:07.059495 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:07.061052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:07.151131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0bec3-109d-44e0-aa84-44ca99864fa0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:07.157873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:07.159013 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:07.159494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:07.159779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:07.176565 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:07.180651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4989-3b0b-4bb4-8a36-642b45f6f4a0 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:07.192658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1390/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:07.791540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:07.793143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:07.810421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7eaf-8ba3-42a0-9c4f-90e77f233f10 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:07.817388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:07.818384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:07.818820 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:07.819313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] PATH_INFO: `/v3/projects/b0d60f4cce754c8bb6a3baa7f552bdfc` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:07.821309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d60f4cce754c8bb6a3baa7f552bdfc)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:07.824088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.004972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d60f4cce754c8bb6a3baa7f552bdfc', 'request_id': 'req-0898c462-9120-4d6e-8f7c-3fb00b359022'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:08.103425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d60f4cce754c8bb6a3baa7f552bdfc', 'request_id': 'req-0898c462-9120-4d6e-8f7c-3fb00b359022'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:08.110642 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d60f4cce754c8bb6a3baa7f552bdfc', 'request_id': 'req-0898c462-9120-4d6e-8f7c-3fb00b359022'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:08.125769 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] The token cache is being invalidate because project b0d60f4cce754c8bb6a3baa7f552bdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:19:08.126127 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:08.126866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0898c462-9120-4d6e-8f7c-3fb00b359022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:19:08.128503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1352/2742] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:19:07 2022] DELETE /identity/v3/projects/b0d60f4cce754c8bb6a3baa7f552bdfc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:19:08.135952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.136595 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.137051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.172440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:08.174672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:08.209785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:08.277690 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1391/2743] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:08.286539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.286849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.287602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.311784 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:08.313152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:08.322015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1353/2744] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:19:08.326682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.337481 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533fc56-ae7c-4880-97b0-d53b213f6110 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.342726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.343415 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.343732 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.344045 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.344967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:19:08.345316 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.347471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.362892 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1392/2745] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:19:08.368930 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.379101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14b34b-8627-48be-8442-396268d4b2af None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.384787 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.385443 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.385727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.386026 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.386704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.388815 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.533826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1354/2746] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:19:08 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:19:08.540952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.551962 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071bcbc-6f34-44e2-9175-01465e3ad48a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.633719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.634784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.635265 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.635756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.636926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.640727 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.799109 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1393/2747] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:19:08 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:19:08.804548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.815910 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2d8ee-c87c-47ef-9475-e851ff7a2c83 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.821993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.822628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.822911 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.823193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.823855 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.825686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.838098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1355/2748] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:19:08.843008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.858843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415dadd-dc01-46fc-b7e6-70e7ea6ff7af admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.867079 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.868023 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.868350 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.868878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.869767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.872772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53cb1c-6e4a-4ea2-8406-cded478a9703 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:08.887920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1394/2749] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:19:08.892384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:08.907259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786791e2-487c-4e90-aa83-e3e0b6d59e35 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:08.914441 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:08.915145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:08.915419 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:08.915701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] PATH_INFO: `/v3/projects/8b3a64318e4d4f9983ec2ff12ad7088f/users/6d46e2bd6c7f4d449d9bbd38066e0769/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:08.936292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3a64318e4d4f9983ec2ff12ad7088f, user_id=6d46e2bd6c7f4d449d9bbd38066e0769, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:08.939767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:09.130194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1356/2750] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:19:08 2022] PUT /identity/v3/projects/8b3a64318e4d4f9983ec2ff12ad7088f/users/6d46e2bd6c7f4d449d9bbd38066e0769/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:19:09.139729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e528c-2666-434c-90f4-50d76df3a07d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:09.140590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e528c-2666-434c-90f4-50d76df3a07d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:09.140590 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e528c-2666-434c-90f4-50d76df3a07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:09.170197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fd3e528c-2666-434c-90f4-50d76df3a07d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:09.171624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fd3e528c-2666-434c-90f4-50d76df3a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:09.251467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1395/2751] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:09.263352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:09.265561 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:09.298826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:09.364798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cee751-4a64-4a41-81ba-d7b105001246 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:09.370603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:09.371577 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:09.372044 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:09.372500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:09.390328 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:09.393194 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:09.413666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1357/2752] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:11.245275 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38d02-68c0-44ba-bec8-87fdce8db742 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:11.245882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38d02-68c0-44ba-bec8-87fdce8db742 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:11.245882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d38d02-68c0-44ba-bec8-87fdce8db742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:11.283137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f9d38d02-68c0-44ba-bec8-87fdce8db742 None None] MFA Rules not processed for user `6d46e2bd6c7f4d449d9bbd38066e0769`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:11.284560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f9d38d02-68c0-44ba-bec8-87fdce8db742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:11.306697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:11.369346 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1396/2753] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:11.385599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:11.391666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:11.480464 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ead7b-23dc-4b6f-81b8-00733adb93ca service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:11.484247 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:11.484922 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:11.485201 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:11.485475 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:11.495470 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:11.496993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:11.513538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1358/2754] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:14.533294 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:14.533933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:14.533933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:14.556249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] MFA Rules not processed for user `6d46e2bd6c7f4d449d9bbd38066e0769`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:14.557634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:14.565209 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1397/2755] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:19:21.504611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=43 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:24.549131 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=22 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:35.142001 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:35.143675 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:35.162471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527fe63-3f31-4d20-abee-c81c53fbd4e2 service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:35.167351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:35.168029 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:35.168340 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:35.168746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:35.170781 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:35.284078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:35.286668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3178fea-81f2-41bc-93e3-d064b3557244 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:35.324775 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1359/2756] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:36.543698 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:36.555423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34340a02-5644-43e5-9de8-3a38cda1f38a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:36.559299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:36.559924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:36.560205 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:36.560483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:36.562468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:36.577369 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:36.579136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:36.592672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1398/2757] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:40.197999 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae30f-414f-4352-b176-82cf12409c07 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:40.198522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae30f-414f-4352-b176-82cf12409c07 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:40.198635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae30f-414f-4352-b176-82cf12409c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:40.221065 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-78bae30f-414f-4352-b176-82cf12409c07 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:40.223884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-78bae30f-414f-4352-b176-82cf12409c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:40.286929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1360/2758] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:19:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:40.312740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:40.314299 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:40.391427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986c858-34c5-44ec-bd64-da6fa1832115 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:40.397688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:40.398306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:40.398585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:40.398851 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:40.407457 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:40.409145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:40.417468 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1399/2759] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:19:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:19:50.279897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=68 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:50.414183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=38 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:51.131622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177d407-d647-4b64-b614-4cc59d313bbd None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:51.131843 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177d407-d647-4b64-b614-4cc59d313bbd None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:51.132088 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177d407-d647-4b64-b614-4cc59d313bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:51.158382 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-a177d407-d647-4b64-b614-4cc59d313bbd None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:51.159650 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-a177d407-d647-4b64-b614-4cc59d313bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:51.170301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1361/2760] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:51.197907 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:51.203611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:51.230368 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2808-dd63-4bed-bc30-45ab84e1e60d service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:51.247072 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:51.248548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:51.249064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:51.249478 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:51.268357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:51.271668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:51.290264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1400/2761] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:56.430375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6419-0e85-470b-9ba0-af76387bbb54 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:56.431240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6419-0e85-470b-9ba0-af76387bbb54 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:56.431240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6419-0e85-470b-9ba0-af76387bbb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:56.453658 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-438c6419-0e85-470b-9ba0-af76387bbb54 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:19:56.454902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-438c6419-0e85-470b-9ba0-af76387bbb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:56.464377 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1362/2762] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:19:56.488383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:56.491220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:56.516946 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841cad-2bd2-485f-b83a-d9b230016b5e service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:56.527007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:56.528058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:56.528603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:56.529107 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:56.544942 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:56.548016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be60a0-2c1f-4e53-8fce-e0d216f1f158 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:56.560999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1401/2763] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:01.126536 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb766-72d0-497d-a5a4-f8c03ce7abea None None] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:01.127192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb766-72d0-497d-a5a4-f8c03ce7abea None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:01.127570 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb766-72d0-497d-a5a4-f8c03ce7abea None None] PATH_INFO: `/` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:01.130195 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1363/2764] 10.222.0.33 () {54 vars in 921 bytes} [Thu Sep 8 14:20:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:20:01.136712 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:01.137305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:01.137305 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:01.171646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:01.172270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:01.172892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:01.188872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] MFA Rules not processed for user `171bca600dcb4dcba12c02fb3dc67197`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:01.190745 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:01.203759 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1402/2765] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Sep 8 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:20:01.220367 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:01.221979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:01.222835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:01.233894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:01.251050 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1364/2766] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:20:01.277074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:01.296499 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708162-ca3d-47ba-897c-ce3bc9edc6ba None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:01.303678 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:01.304320 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:01.304643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:01.304925 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:01.312374 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b181-70a5-47af-b2b1-eb7916599790 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:01.313832 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:01.315517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:01.316952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:01.317748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:01.318128 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:01.318529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:01.325444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1365/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:01.335181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:01.336890 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333b698-0803-421a-9bc7-2ecc8cbbf4c2 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:01.352651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1403/2768] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:20:03.929417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:03.939482 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22c48-5de5-4bd1-b5a3-16f3df2d299d service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:03.945356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:03.946266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:03.946711 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:03.947113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:03.950268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:03.970350 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:03.971825 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be4b6-6106-4538-9590-6563dd9229f8 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:03.983361 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1366/2769] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:04.982412 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:04.983048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:04.983427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:05.034307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:05.034897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:05.034897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:05.048634 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:05.049871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:05.057111 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:05.058385 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:05.066516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1367/2770] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:05.070398 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1404/2771] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:20:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:05.084081 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:05.089022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:05.102597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0238-231f-4c5e-a56c-ac2ab241a97a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:05.108553 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:05.109182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:05.109463 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:05.109737 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:05.113987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952a260-48a4-42da-bedc-30d5e5a721da None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:05.119635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:05.120716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:05.121279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e92f0b-b5fe-46ba-8a16-e4a135d785e4 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:05.121440 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:05.121608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:05.121884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:05.131034 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:05.132362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1405/2772] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:20:05.133313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:05.143502 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1368/2773] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:20:15.127344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=71 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:15.139209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=34 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:17.619898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:17.623127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:17.623127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:17.642710 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:17.644027 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:17.655176 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1406/2774] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:17.675968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:17.689444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467a37b-224c-4540-b684-546d217f27a1 service swift] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:17.695788 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:17.696390 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:17.696718 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:17.696974 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:17.706432 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:17.708777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb759b-42a3-4f8c-9f66-41ecfc302e0e service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:17.719153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1369/2775] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:18.258784 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:18.277603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d3cb0-de54-4776-8eb2-b82b89ea73f8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:18.285250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:18.287134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:18.287637 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:18.288159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:18.290429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:18.390958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:18.393961 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:18.412505 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1407/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:20.963384 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c273e-d455-414d-beb5-59017b8aaf74 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:20.963899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c273e-d455-414d-beb5-59017b8aaf74 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:20.963899 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c273e-d455-414d-beb5-59017b8aaf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:20.985289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7c7c273e-d455-414d-beb5-59017b8aaf74 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:20.986497 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7c7c273e-d455-414d-beb5-59017b8aaf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:20.997051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1370/2777] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:21.028767 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:21.040815 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292ac5b-7329-4879-9080-65d483cb4029 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:21.046556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:21.047182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:21.047461 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:21.047736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:21.057718 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:21.059310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:21.070953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1408/2778] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:21.221483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:21.221774 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:21.222075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:21.242312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:21.243529 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:21.250898 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1371/2779] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:21.263529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:21.275790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9b05-dc43-4317-be38-673f0b33ae24 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:21.280901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:21.281513 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:21.281798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:21.282071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:21.291573 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:21.293269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76e7f-b4fe-45cf-9989-aacf2182b8af service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:21.303145 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1409/2780] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:20:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:20:31.236622 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=12 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:31.298603 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=43 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:31.699300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:31.712742 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7de0c7-2576-4d5b-b2b5-518db44453a2 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:31.721098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:31.721710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:31.721995 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:31.722272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:31.724004 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:31.737451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:31.739094 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:31.751851 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1372/2781] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:38.636983 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:38.637878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:38.637878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:38.659354 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] MFA Rules not processed for user `6d46e2bd6c7f4d449d9bbd38066e0769`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:38.661011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:38.669319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1410/2782] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:39.438829 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:39.440580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:39.519045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf99934-5ed2-4e5e-8dab-10815af6deb5 service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:39.524162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:39.528990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:39.528990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:39.528990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:39.528990 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:39.542427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:39.544144 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e7eaa-2024-438e-892e-fe7111b0e508 service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:39.555525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1373/2783] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:48.651685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:49.550751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=38 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:50.706812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:50.721170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd9b7d-9f5d-4126-8d0e-d8cc8fb458df None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:50.726850 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:50.727472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:50.727757 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:50.728035 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:50.729931 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:50.744475 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:50.757801 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:50.759192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1411/2784] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:20:58.974189 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c370-c978-4be4-a20b-e7277f415dee None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:58.974720 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c370-c978-4be4-a20b-e7277f415dee None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:58.974877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c370-c978-4be4-a20b-e7277f415dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:59.007424 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-7913c370-c978-4be4-a20b-e7277f415dee None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:59.008776 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-7913c370-c978-4be4-a20b-e7277f415dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:59.018567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1374/2785] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:59.040255 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:59.052683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791d094-f1c2-475a-b859-1f1220cf299d service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:59.059967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:59.061089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:59.061089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:59.061361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:59.071291 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:59.073038 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:59.086026 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1412/2786] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:02.586283 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6229a9-ab05-4d3e-9f84-145ba004319b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:02.586864 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6229a9-ab05-4d3e-9f84-145ba004319b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:02.587105 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6229a9-ab05-4d3e-9f84-145ba004319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:02.609236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-4b6229a9-ab05-4d3e-9f84-145ba004319b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:02.610468 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-4b6229a9-ab05-4d3e-9f84-145ba004319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:02.622685 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1375/2787] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:02.646459 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:02.658803 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a5137-1f29-41fa-9ec2-3c5b6934a40d service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:02.664397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:02.665037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:02.665339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:02.665586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:02.674570 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:02.676269 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:02.686951 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1413/2788] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:05.517959 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:05.518994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:05.518994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:05.542595 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:05.543968 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:05.552755 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1376/2789] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:05.581188 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:05.598528 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e724e9e-c25a-436d-a171-033a793beaad service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:05.604653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:05.605616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:05.607729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:05.607729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:05.617450 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:05.619978 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa2fd4-4d78-4a7c-828b-910e1cdb3251 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:05.634279 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1414/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:07.461484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:07.478118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7576b5-390a-44e5-a867-d6133ea35d15 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:07.482655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:07.483300 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:07.483584 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:07.483892 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:07.485758 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:07.499579 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:07.501089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:07.512292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1377/2791] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:08.711007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:08.711610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:08.711610 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:08.734157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:08.735402 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:08.748744 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1415/2792] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:08.775538 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:08.790049 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4140b-3fcc-45ff-8602-1fcbdff558fc service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:08.797476 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:08.798490 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:08.798634 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:08.798901 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:08.809516 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:08.811243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:08.822425 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1378/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:11.868939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:11.870498 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:11.892370 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc2dc-d136-4e09-ba3d-5f4f97fc2f5a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:11.898180 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:11.898822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:11.899103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:11.899383 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:11.901231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:11.914675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:11.916315 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf2efe-dd47-4d07-a267-72fd548b41da service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:11.928668 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1416/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:12.064558 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:12.066115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:12.082404 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7caf02-0d91-4b04-bc4c-de9cef8d1cd1 service nova] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:12.089773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:12.090422 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:12.090704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:12.090976 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] PATH_INFO: `/v3/users/544278669a2d4884bcfc7c2f7dbff624` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:12.092120 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544278669a2d4884bcfc7c2f7dbff624)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:12.094405 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:12.366392 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544278669a2d4884bcfc7c2f7dbff624'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:12.470960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544278669a2d4884bcfc7c2f7dbff624'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:12.471854 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544278669a2d4884bcfc7c2f7dbff624'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:12.483762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544278669a2d4884bcfc7c2f7dbff624'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:12.502434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544278669a2d4884bcfc7c2f7dbff624'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:12.509414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1379/2795] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:12 2022] DELETE /identity/v3/users/544278669a2d4884bcfc7c2f7dbff624 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:13.050302 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.050953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.050953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.075921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:13.077191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:13.095649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:13.099556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:13.163518 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1417/2796] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Sep 8 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:13.181794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f41c3-0e18-4ca6-bbcb-874095030c17 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:13.187351 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:13.188171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:13.188874 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.188999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:13.189200 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.189460 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] PATH_INFO: `/v3/projects/ec48c3a2711f421b84c275c9591c7ce6` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.190660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec48c3a2711f421b84c275c9591c7ce6)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:13.192738 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:13.276044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5bd3b-fdb6-4461-95ee-176ecc87c8ab None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:13.286052 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:13.286886 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.287220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.287544 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.298761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:13.300740 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c3a1-0655-44be-bc7b-404abb956090 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:13.314191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1418/2797] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:13.342238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:13.359730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec48c3a2711f421b84c275c9591c7ce6', 'request_id': 'req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:13.442015 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec48c3a2711f421b84c275c9591c7ce6', 'request_id': 'req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:13.448284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec48c3a2711f421b84c275c9591c7ce6', 'request_id': 'req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:13.462659 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] The token cache is being invalidate because project ec48c3a2711f421b84c275c9591c7ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:13.462980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:13.463831 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-48365d8a-8db1-4c3f-a0d6-5fd3422beb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:13.466056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1380/2798] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:13 2022] DELETE /identity/v3/projects/ec48c3a2711f421b84c275c9591c7ce6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:13.474127 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.474533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.474827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.498552 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:13.500111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:13.512861 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:13.575529 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1419/2799] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:13.584413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.585011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.585389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.611807 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:13.613091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:13.622948 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1381/2800] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:13.629054 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:13.657762 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9fc97-183c-413d-b063-a78bb38f465b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:13.663245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:13.663895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.664177 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.664467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.665148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:13.665455 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:13.667094 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:13.681579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1420/2801] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:13.686244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:13.696232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b5027-6cda-4463-a393-503927ba05dc None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:13.702431 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:13.703165 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.703452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.703728 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.704389 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:13.706630 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:13.819953 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1382/2802] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:13.825658 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:13.838361 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66e29-1d45-4255-9ac3-0104a0d1bdfe admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:13.902794 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:13.903567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:13.903846 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:13.904121 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:13.904804 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:13.906747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:14.024893 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1421/2803] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:13 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:21:14.030143 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:14.041142 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1bdfd-779f-482a-9d0e-88bd681d6e4b admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:14.047037 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:14.047733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:14.048072 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:14.048435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:14.049225 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:14.050834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:14.062388 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1383/2804] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:14.067932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:14.082229 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0b8d-ae66-4839-8f52-a50ad5f5da6a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:14.087046 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:14.087674 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:14.087952 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:14.088230 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:14.088947 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:14.091251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c0973-262c-484f-aa50-68089cb3ec87 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:14.103539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1422/2805] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:21:14.109417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:14.120757 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd77c21-e673-470f-afe4-99023be80426 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:14.126828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:14.127519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:14.127800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:14.128236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] PATH_INFO: `/v3/projects/f1abd2a4ab994fa3a3e4c24dd82aa814/users/943d02541b174c2fb57bc8506c31c4e1/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:14.145868 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1abd2a4ab994fa3a3e4c24dd82aa814, user_id=943d02541b174c2fb57bc8506c31c4e1, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:14.148932 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:14.283277 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1384/2806] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:14 2022] PUT /identity/v3/projects/f1abd2a4ab994fa3a3e4c24dd82aa814/users/943d02541b174c2fb57bc8506c31c4e1/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:14.295982 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:14.296268 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:14.296653 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:14.330059 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] MFA Rules not processed for user `943d02541b174c2fb57bc8506c31c4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:14.331339 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:14.412959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1423/2807] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:14.433985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:14.436345 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:14.520206 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc0ff-fd69-4ef3-8faa-830f8c6727d7 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:14.527539 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:14.528363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:14.528688 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:14.528993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:14.539024 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:14.540571 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96a55f-a401-4e0d-9167-cf0d25e74983 service nova] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:14.550710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1385/2808] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:18.387245 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:18.396479 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:18.455371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca0a7-640f-4943-bb54-1aba4b8f013b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:18.460003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:18.461021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:18.461021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:18.461278 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] PATH_INFO: `/v3/users/943d02541b174c2fb57bc8506c31c4e1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:18.462602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=943d02541b174c2fb57bc8506c31c4e1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:18.465608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:18.715211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943d02541b174c2fb57bc8506c31c4e1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:18.864810 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943d02541b174c2fb57bc8506c31c4e1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:18.865514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943d02541b174c2fb57bc8506c31c4e1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:18.881241 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943d02541b174c2fb57bc8506c31c4e1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:18.892562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943d02541b174c2fb57bc8506c31c4e1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:18.895635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1424/2809] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:18 2022] DELETE /identity/v3/users/943d02541b174c2fb57bc8506c31c4e1 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:18.900130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:18.900633 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:18.900763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:18.921604 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:18.922865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:18.959233 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:18.990145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1386/2810] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:19.001064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:19.002632 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:19.068096 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a519-44e3-4e14-8c16-bac595683e8e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:19.071735 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:19.072344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:19.072659 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:19.072933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:19.083499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:19.084975 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c000830-5b7d-475d-b79d-68946b8da0a6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:19.095427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1425/2811] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:19.608861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:19.610318 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:19.622960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb815b-8e87-497f-9d12-61da11b01066 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:19.630232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:19.630961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:19.631282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:19.631564 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] PATH_INFO: `/v3/projects/f1abd2a4ab994fa3a3e4c24dd82aa814` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:19.633104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1abd2a4ab994fa3a3e4c24dd82aa814)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:19.635134 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:19.797108 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1abd2a4ab994fa3a3e4c24dd82aa814', 'request_id': 'req-7c1c7088-aa95-448d-9e6d-d5356523addb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:19.871439 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1abd2a4ab994fa3a3e4c24dd82aa814', 'request_id': 'req-7c1c7088-aa95-448d-9e6d-d5356523addb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:19.878011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1abd2a4ab994fa3a3e4c24dd82aa814', 'request_id': 'req-7c1c7088-aa95-448d-9e6d-d5356523addb'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:19.892593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] The token cache is being invalidate because project f1abd2a4ab994fa3a3e4c24dd82aa814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:19.893179 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:19.893985 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-7c1c7088-aa95-448d-9e6d-d5356523addb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:19.895739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1387/2812] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:19 2022] DELETE /identity/v3/projects/f1abd2a4ab994fa3a3e4c24dd82aa814 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:19.900993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:19.901562 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:19.902474 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:19.922709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:19.923913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:19.952119 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:19.987429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1426/2813] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:19.995548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630115-232b-4b99-9348-972757d8f959 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:19.999800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630115-232b-4b99-9348-972757d8f959 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:19.999800 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630115-232b-4b99-9348-972757d8f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.017498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-1b630115-232b-4b99-9348-972757d8f959 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:20.018743 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1b630115-232b-4b99-9348-972757d8f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:20.028060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1388/2814] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:20.032409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.043471 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097d08e-88f3-4f06-9774-c6cb0febb4c8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.048489 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.049143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.049448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.049704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.050362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:20.050670 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.052282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.065805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1427/2815] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:20.070496 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630115-232b-4b99-9348-972757d8f959 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.081086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630115-232b-4b99-9348-972757d8f959 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.085773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.086402 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.086741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.086940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.087573 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.089546 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.175293 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1389/2816] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:20 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:20.179932 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.191048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515d9f-0772-4ecc-94bc-5a8ec876d25e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.249560 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.250174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.250452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.250726 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.251360 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.253337 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.400956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1428/2817] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:20 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:20.405530 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.416317 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04d1d-4175-4dcb-988a-dc8815ca246a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.421040 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.421651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.421931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.422204 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.422848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.424435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.435337 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1390/2818] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:20.439439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.450348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355ef29-86c1-4f78-a9c7-5f4dc0004d3d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.455325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.455959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.456237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.456520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.457170 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.458751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8411-b8ce-4ccc-a145-4e22af80b376 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.470760 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1429/2819] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:20.475002 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.485299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de0944-c727-4fba-a09f-780379882aa8 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.489827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.490483 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.490763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.491036 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] PATH_INFO: `/v3/projects/d55fb802f8c84dd29dada1c9ee5ee272/users/d8b4cad67ef14ae9af8a63b3d9c91e71/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.508104 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55fb802f8c84dd29dada1c9ee5ee272, user_id=d8b4cad67ef14ae9af8a63b3d9c91e71, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.511731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.585011 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1391/2820] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:20 2022] PUT /identity/v3/projects/d55fb802f8c84dd29dada1c9ee5ee272/users/d8b4cad67ef14ae9af8a63b3d9c91e71/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:20.595729 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.596062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.596298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.626725 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] MFA Rules not processed for user `d8b4cad67ef14ae9af8a63b3d9c91e71`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:20.627996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:20.702748 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1430/2821] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:20.707557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.773268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:20.777240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f0e0-c5f0-4e45-b9bf-0112ffa0f6dc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.782753 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.783116 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.783398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.783690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.784375 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.786454 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:20.884045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1392/2822] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:20 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:20.888237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:20.899511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc12999-dcee-4891-9a77-c15d4214ecc6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:20.931574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:20.971422 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:20.972044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:20.972328 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:20.972628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:20.973276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:20.975281 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.082778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1431/2823] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:20 2022] POST /identity/v3/users => generated 309 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:21.086993 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.099646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040e31-4c49-4416-8b35-9a8190af026c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.104407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.105240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.105739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.106242 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.106676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.108298 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.119176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1393/2824] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:21.123948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.134597 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724b7a9-acef-4b56-b850-eee0b6e82541 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.140827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.141508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.141790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.142067 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] PATH_INFO: `/v3/projects/48050667f44e4812bb184612e2f79339/users/b21749d839644be8976281c2859df181/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.159178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48050667f44e4812bb184612e2f79339, user_id=b21749d839644be8976281c2859df181, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.161927 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.288689 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1432/2825] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:21 2022] PUT /identity/v3/projects/48050667f44e4812bb184612e2f79339/users/b21749d839644be8976281c2859df181/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:21.293416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.305842 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb3d4-4620-431f-bc74-b5d28763f0c4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.378744 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.379356 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.379635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.379905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.380567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.382178 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ecee5-e527-4add-bf81-9e2247beeca6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.393823 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1394/2826] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:21.398442 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.409273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d010-e7a7-4c2a-b576-f80ef8423238 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.414921 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.415629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.415911 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.416185 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] PATH_INFO: `/v3/projects/48050667f44e4812bb184612e2f79339/users/b21749d839644be8976281c2859df181/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.418244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48050667f44e4812bb184612e2f79339, user_id=b21749d839644be8976281c2859df181, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.420944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.432304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1433/2827] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:21 2022] PUT /identity/v3/projects/48050667f44e4812bb184612e2f79339/users/b21749d839644be8976281c2859df181/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:21.444491 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.444824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.445098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.477596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] MFA Rules not processed for user `b21749d839644be8976281c2859df181`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:21.478834 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:21.554593 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1395/2828] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:21.567755 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.569494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:21.631672 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c23072-a4ed-46c5-a887-083088ef0ea8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.635746 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.636775 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.637210 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.637492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.647431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.649036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb4135-f12e-4b1f-a4d5-2a26d023cc89 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:21.660017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1434/2829] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:21.830741 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:21.901794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:21.920879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c084d-9003-44ac-b885-348e1f787c21 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:21.932278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:21.933733 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:21.934133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:21.934413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] PATH_INFO: `/v3/users/d8b4cad67ef14ae9af8a63b3d9c91e71` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:21.935717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b4cad67ef14ae9af8a63b3d9c91e71)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:21.937975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:22.303188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b4cad67ef14ae9af8a63b3d9c91e71'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:22.413157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b4cad67ef14ae9af8a63b3d9c91e71'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:22.413762 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b4cad67ef14ae9af8a63b3d9c91e71'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:22.421904 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b4cad67ef14ae9af8a63b3d9c91e71'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:22.435332 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b4cad67ef14ae9af8a63b3d9c91e71'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:22.441557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1396/2830] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:21 2022] DELETE /identity/v3/users/d8b4cad67ef14ae9af8a63b3d9c91e71 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:22.446178 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:22.447126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:22.447126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:22.467902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:22.469171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:22.532385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1435/2831] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:22.542268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:22.543704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:22.603115 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac7ab5-c0af-41cb-8d22-383d995ce6a9 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:22.607123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:22.607747 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:22.608031 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:22.608309 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:22.618258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:22.619704 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:22.630146 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1397/2832] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:23.082813 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:23.087118 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:23.098410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2765-bdde-439f-b911-30b0ebf68c80 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:23.103511 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:23.104456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:23.104805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:23.105877 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] PATH_INFO: `/v3/projects/d55fb802f8c84dd29dada1c9ee5ee272` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:23.107240 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55fb802f8c84dd29dada1c9ee5ee272)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:23.109520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:23.128122 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:23.263321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55fb802f8c84dd29dada1c9ee5ee272', 'request_id': 'req-74208742-26d9-4836-af53-f7530372c9bb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.391231 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55fb802f8c84dd29dada1c9ee5ee272', 'request_id': 'req-74208742-26d9-4836-af53-f7530372c9bb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.399539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55fb802f8c84dd29dada1c9ee5ee272', 'request_id': 'req-74208742-26d9-4836-af53-f7530372c9bb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.420566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] The token cache is being invalidate because project d55fb802f8c84dd29dada1c9ee5ee272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:23.420920 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.421656 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.423357 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1436/2833] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:23 2022] DELETE /identity/v3/projects/d55fb802f8c84dd29dada1c9ee5ee272 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:23.429086 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:23.440581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc414-8d55-45b2-a390-60b135d0f1d5 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:23.519414 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:23.520119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:23.520399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:23.520716 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] PATH_INFO: `/v3/users/b21749d839644be8976281c2859df181` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:23.522091 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21749d839644be8976281c2859df181)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:23.524794 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:23.545297 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:23.815035 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21749d839644be8976281c2859df181'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.899255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21749d839644be8976281c2859df181'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.899946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21749d839644be8976281c2859df181'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.908407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21749d839644be8976281c2859df181'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.923548 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-93f5128b-8f03-40a2-ba3c-5746ba32d171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21749d839644be8976281c2859df181'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:23.931090 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1398/2834] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:23 2022] DELETE /identity/v3/users/b21749d839644be8976281c2859df181 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:24.603465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:24.608494 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:24.621785 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74208742-26d9-4836-af53-f7530372c9bb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:24.687696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:24.688363 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:24.688696 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:24.688988 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] PATH_INFO: `/v3/projects/48050667f44e4812bb184612e2f79339` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:24.690157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48050667f44e4812bb184612e2f79339)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:24.692064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:24.860070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48050667f44e4812bb184612e2f79339', 'request_id': 'req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:24.954452 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48050667f44e4812bb184612e2f79339', 'request_id': 'req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:24.961309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48050667f44e4812bb184612e2f79339', 'request_id': 'req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:24.983917 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] The token cache is being invalidate because project 48050667f44e4812bb184612e2f79339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:24.984216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:24.984902 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-80a7bab8-0f48-4b7e-94b1-0dfb163cca25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:24.986625 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1437/2835] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:24 2022] DELETE /identity/v3/projects/48050667f44e4812bb184612e2f79339 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:24.991266 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:24.991725 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:24.991814 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.015531 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:25.016808 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:25.089477 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1399/2836] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:25.098032 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.098406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.098693 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.119829 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:25.122009 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:25.130758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1438/2837] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:25.135138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.146220 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a6038-914e-4a62-bc80-ab837fbd8c46 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.150951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.151636 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.152074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.152358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.153416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:25.153416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.155055 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.167540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1400/2838] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:25.182329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.193554 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048ba5-40ba-4baa-868d-4c7209e3d55a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.199376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.200243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.200555 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.200841 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.201483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.203492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.305954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1439/2839] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:25 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:25.311221 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.321839 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9150-5ced-4dc7-918f-0998c8cfba76 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.382615 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.383239 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.383524 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.384051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.384817 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.386853 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.534971 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1401/2840] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:25 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:25.539579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.551963 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12336c76-0de6-4f8e-a8fe-4d1b3c5d39f7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.556987 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.557758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.558662 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.558944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.559616 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.561259 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.563130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:25.577165 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1440/2841] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:21:25.578452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.589599 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b7b35-4abc-41b3-b64d-6e8df7d1db62 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.594503 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.595112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.595398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.595677 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.596654 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.598368 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d9e0c-fd7c-43b1-973b-46c83d952fbc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.606272 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:25.611498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1402/2842] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:25.615575 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.626699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e8260-7efe-4578-bf55-f200af95cadb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:25.631628 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:25.637584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.637584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.637584 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] PATH_INFO: `/v3/projects/e3a069be607349fba056dfaa5ba980b1/users/9f3f5aadae4a42b69eb305283d348ee7/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.655396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a069be607349fba056dfaa5ba980b1, user_id=9f3f5aadae4a42b69eb305283d348ee7, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:25.658138 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:25.809606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1441/2843] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:25 2022] PUT /identity/v3/projects/e3a069be607349fba056dfaa5ba980b1/users/9f3f5aadae4a42b69eb305283d348ee7/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:25.819619 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:25.819909 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:25.820187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:25.853082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] MFA Rules not processed for user `9f3f5aadae4a42b69eb305283d348ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:25.854329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:25.921960 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1403/2844] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:25.926998 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:25.994248 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595066f2-6817-452f-9a7c-a06a276594f5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.001705 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.002352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.003030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.003392 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.006134 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.006251 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.101150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1442/2845] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:25 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:21:26.102478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.115062 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c72d-b58d-4647-bf63-9f48a778673b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.186285 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.186941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.187219 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.187519 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.188175 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.190301 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.294647 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1404/2846] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:26 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:21:26.298970 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.310273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239356d-ce98-43c0-8dc5-9aaa77cad29c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.315150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.315758 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.316037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.316309 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.316992 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.318578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.329651 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1443/2847] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:26.334342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.344474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15466c5-9cbe-4a2c-9b52-5c96f79efa3a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.349335 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.349992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.350269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.350543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] PATH_INFO: `/v3/projects/da95f039fc434921b955e9dde9d52a98/users/aa55072d3f62437c99f2ebb465617c4b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.366877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da95f039fc434921b955e9dde9d52a98, user_id=aa55072d3f62437c99f2ebb465617c4b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.369557 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.572906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1405/2848] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:26 2022] PUT /identity/v3/projects/da95f039fc434921b955e9dde9d52a98/users/aa55072d3f62437c99f2ebb465617c4b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:26.577169 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.587805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a6b04-49f1-4726-9a05-cfbbaa2abf99 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.648232 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.648918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.649050 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.649329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.649991 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.652207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c5a81-1784-4864-9798-867203026f04 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.663252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1444/2849] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:26.668138 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.679069 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532511e0-98ef-436f-87d5-cd40bbc68fd1 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.686602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.687289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.687575 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.687877 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] PATH_INFO: `/v3/projects/da95f039fc434921b955e9dde9d52a98/users/aa55072d3f62437c99f2ebb465617c4b/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.689933 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da95f039fc434921b955e9dde9d52a98, user_id=aa55072d3f62437c99f2ebb465617c4b, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.692772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.705321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1406/2850] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:26 2022] PUT /identity/v3/projects/da95f039fc434921b955e9dde9d52a98/users/aa55072d3f62437c99f2ebb465617c4b/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:26.775743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.775743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.775743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.810842 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] MFA Rules not processed for user `aa55072d3f62437c99f2ebb465617c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:26.812120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:26.845688 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:26.889103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1445/2851] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:26.899761 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:26.901397 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:26.950188 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:26.962652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42247-9790-4939-9e23-a2fac80f0e36 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:26.967352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:26.967964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:26.968249 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:26.968554 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:26.978935 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:26.980662 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da871d3f-24f7-45fe-a81e-603aba218e7a service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:26.990768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1407/2852] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:30.981645 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:31.047824 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594877c-2027-4789-bf24-eb50832b8d99 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:31.052472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:31.053136 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:31.053427 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:31.053692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] PATH_INFO: `/v3/users/9f3f5aadae4a42b69eb305283d348ee7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:31.054833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3f5aadae4a42b69eb305283d348ee7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:31.056830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:31.350016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3f5aadae4a42b69eb305283d348ee7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:31.487816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3f5aadae4a42b69eb305283d348ee7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:31.488631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3f5aadae4a42b69eb305283d348ee7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:31.503284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3f5aadae4a42b69eb305283d348ee7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:31.519908 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3f5aadae4a42b69eb305283d348ee7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:31.526548 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1446/2853] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:30 2022] DELETE /identity/v3/users/9f3f5aadae4a42b69eb305283d348ee7 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:31.537222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:31.537222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:31.537222 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:31.558918 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:31.560307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:31.623282 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1408/2854] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:31.633533 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:31.635284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:31.691431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:31.696956 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c9795-ef42-4bca-beb1-1958513d7e85 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:31.701967 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:31.702579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:31.702864 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:31.703158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:31.713062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:31.715100 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:31.725480 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1447/2855] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:32.273484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:32.275498 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:32.293117 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac399ae-2ea8-49ed-925f-3c41a4ac2883 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:32.300099 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:32.301835 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:32.302238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:32.302937 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] PATH_INFO: `/v3/projects/e3a069be607349fba056dfaa5ba980b1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:32.305176 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a069be607349fba056dfaa5ba980b1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:32.307039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:32.460229 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a069be607349fba056dfaa5ba980b1', 'request_id': 'req-b193e689-ac9b-4027-9155-8c3d40d5c98a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:32.584931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a069be607349fba056dfaa5ba980b1', 'request_id': 'req-b193e689-ac9b-4027-9155-8c3d40d5c98a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:32.592528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a069be607349fba056dfaa5ba980b1', 'request_id': 'req-b193e689-ac9b-4027-9155-8c3d40d5c98a'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:32.607540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] The token cache is being invalidate because project e3a069be607349fba056dfaa5ba980b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:32.607838 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:32.608566 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:32.610118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1409/2856] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:32 2022] DELETE /identity/v3/projects/e3a069be607349fba056dfaa5ba980b1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:32.614246 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:32.624887 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00303-057b-48e0-bf5b-5bd19c202019 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:32.685288 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:32.685990 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:32.686272 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:32.686551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] PATH_INFO: `/v3/users/aa55072d3f62437c99f2ebb465617c4b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:32.687709 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa55072d3f62437c99f2ebb465617c4b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:32.689655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:32.943903 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa55072d3f62437c99f2ebb465617c4b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.047605 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa55072d3f62437c99f2ebb465617c4b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.048237 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa55072d3f62437c99f2ebb465617c4b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.061923 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa55072d3f62437c99f2ebb465617c4b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.069596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a016fe88-55d6-4983-9361-cfe6b29c820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa55072d3f62437c99f2ebb465617c4b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.077306 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1448/2857] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:32 2022] DELETE /identity/v3/users/aa55072d3f62437c99f2ebb465617c4b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:33.608673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:33.610148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:33.627075 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193e689-ac9b-4027-9155-8c3d40d5c98a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:33.693241 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:33.694042 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:33.694329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:33.694603 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] PATH_INFO: `/v3/projects/da95f039fc434921b955e9dde9d52a98` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:33.695827 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da95f039fc434921b955e9dde9d52a98)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:33.697951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:33.712187 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:33.844540 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da95f039fc434921b955e9dde9d52a98', 'request_id': 'req-75b0ba25-3851-4809-922f-22737dd92402'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.966303 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da95f039fc434921b955e9dde9d52a98', 'request_id': 'req-75b0ba25-3851-4809-922f-22737dd92402'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.973983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da95f039fc434921b955e9dde9d52a98', 'request_id': 'req-75b0ba25-3851-4809-922f-22737dd92402'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.989848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] The token cache is being invalidate because project da95f039fc434921b955e9dde9d52a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:33.990240 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.990950 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-75b0ba25-3851-4809-922f-22737dd92402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:33.992474 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1410/2858] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:33 2022] DELETE /identity/v3/projects/da95f039fc434921b955e9dde9d52a98 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:33.997882 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:33.998380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:33.998496 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.019977 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:34.021242 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:34.089913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1449/2859] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:34.098181 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.098376 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.098663 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.122253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:34.123400 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:34.131649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1411/2860] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:34.136016 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.146629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846dc50-eee1-490b-a4f3-a6583b5728e8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.151335 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.151939 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.152217 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.153019 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.153914 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:34.154220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.155862 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.158540 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:34.168044 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1450/2861] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:21:34.173164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.182568 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1552988-94e8-4ef5-ac59-a6e370aebed0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.188299 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.189012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.189292 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.189589 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.190463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.192416 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.399255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1412/2862] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:34 2022] POST /identity/v3/projects => generated 389 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:34.403699 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.413772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd70d1-21d3-4a5b-afd0-7f2541aa3f95 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.486984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.486984 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.487476 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.487598 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.488166 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.490203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.646832 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1451/2863] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:34 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:34.651113 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.668268 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed47fa-d2fe-42c8-90a6-89611de7b860 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.673250 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.673871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.674198 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.674655 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.675325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.676994 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.688896 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1413/2864] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:34.693139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.710144 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaf4e0-dd6d-4a0f-8e03-7769055b7d27 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.715108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.715872 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.716783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.716783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.717161 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.718855 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1e3b2-28fe-42b9-9b52-6a71be1667f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.731074 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1452/2865] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:34.737398 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.752455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e03f8-191b-4fc8-a627-de6be0eaed2d admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.757051 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.757707 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.757991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.758270 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] PATH_INFO: `/v3/projects/a4e0259498c3465dab180fc2907b2d26/users/21a562ed01d84990a6252900cb5e0185/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.775879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e0259498c3465dab180fc2907b2d26, user_id=21a562ed01d84990a6252900cb5e0185, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.779352 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.915551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1414/2866] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:34 2022] PUT /identity/v3/projects/a4e0259498c3465dab180fc2907b2d26/users/21a562ed01d84990a6252900cb5e0185/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:34.929539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.929828 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.930221 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.962769 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] MFA Rules not processed for user `21a562ed01d84990a6252900cb5e0185`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:34.964895 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:35.032276 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1453/2867] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:35.036981 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.103218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afe1a-5ef2-4c66-83ef-3ef649c9fece admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.109019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.109683 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.109961 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.110232 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] PATH_INFO: `/v3/projects` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.110887 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.112865 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.272714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1415/2868] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:35 2022] POST /identity/v3/projects => generated 389 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:35.277675 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.290158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256664-b2dd-42cb-b7ca-b074bbb86006 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.354110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.354747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.355120 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.355395 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.356093 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.358703 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.369959 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:35.455034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1454/2869] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:35 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:35.459417 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.470442 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cffe4-06c6-4571-890a-74d83bd8acae admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.475651 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.476308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.476629 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.476908 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.477563 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.479184 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.491289 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1416/2870] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:35.501572 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.511827 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496111b7-69fc-4dfb-82cc-3b11f7472736 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.518025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.518738 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.519021 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.519311 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] PATH_INFO: `/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd/users/45bd872f1f344ec9b5f2214956cd1ce4/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.535697 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a92a8bf1f84baa8d167e2950f4ecfd, user_id=45bd872f1f344ec9b5f2214956cd1ce4, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.538329 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.637089 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1455/2871] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:35 2022] PUT /identity/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd/users/45bd872f1f344ec9b5f2214956cd1ce4/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:35.641966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.653074 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394fdb-ba60-4597-b8ad-4d5c0682196a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.658244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:35.719171 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.720076 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.720363 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.720676 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.721378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.722946 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55151832-ba9c-46dd-a869-27e7d5176e37 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.738697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1417/2872] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:35.739772 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.751843 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea181b1-f7bc-4a2d-ae78-352ea01e9df1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.758472 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.759034 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.759423 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.759739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] PATH_INFO: `/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd/users/45bd872f1f344ec9b5f2214956cd1ce4/roles/7344c45181b34c769b527731ca22627a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.765164 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a92a8bf1f84baa8d167e2950f4ecfd, user_id=45bd872f1f344ec9b5f2214956cd1ce4, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:35.768652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:35.782174 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1456/2873] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:35 2022] PUT /identity/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd/users/45bd872f1f344ec9b5f2214956cd1ce4/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:35.794883 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.795209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.795793 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:35.827243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] MFA Rules not processed for user `45bd872f1f344ec9b5f2214956cd1ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:35.828591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:35.906919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1418/2874] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:35.914501 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:35.916207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:35.988488 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07767e0-b3dc-4f80-af1a-360374d54fe3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:35.992837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:35.997837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:35.997837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:35.997837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:36.005564 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:36.007031 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334f50d-0b0f-4cb2-b009-a4167e7fe8e8 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:36.020203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1457/2875] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:36.179510 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:36.249660 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a371783-bb77-4411-a800-0c6aff47e724 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:36.254500 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:36.255148 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:36.255435 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:36.255717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] PATH_INFO: `/v3/users/21a562ed01d84990a6252900cb5e0185` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:36.256914 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a562ed01d84990a6252900cb5e0185)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:36.258850 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:36.511701 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:36.527727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a562ed01d84990a6252900cb5e0185'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:36.651875 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a562ed01d84990a6252900cb5e0185'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:36.652703 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a562ed01d84990a6252900cb5e0185'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:36.661586 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a562ed01d84990a6252900cb5e0185'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:36.674374 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a562ed01d84990a6252900cb5e0185'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:36.680941 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1419/2876] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:36 2022] DELETE /identity/v3/users/21a562ed01d84990a6252900cb5e0185 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:36.685933 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:36.686430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:36.686566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:36.707157 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:36.708438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:36.772203 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1458/2877] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:36.782770 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:36.784278 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:36.853532 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb95f-7755-4bed-9cce-ba2add48a691 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:36.859413 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:36.860041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:36.867489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:36.867489 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:36.870697 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:36.873336 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:36.886856 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1420/2878] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:37.374262 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:37.375830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:37.389469 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dbeb1-e548-4114-9b20-599f36473614 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:37.394438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:37.395273 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:37.395631 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:37.395840 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] PATH_INFO: `/v3/projects/a4e0259498c3465dab180fc2907b2d26` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:37.397030 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e0259498c3465dab180fc2907b2d26)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:37.398934 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:37.552211 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e0259498c3465dab180fc2907b2d26', 'request_id': 'req-49d6e88c-9dee-4389-b963-f7f1bf418660'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:37.556282 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:37.670869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e0259498c3465dab180fc2907b2d26', 'request_id': 'req-49d6e88c-9dee-4389-b963-f7f1bf418660'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:37.677604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e0259498c3465dab180fc2907b2d26', 'request_id': 'req-49d6e88c-9dee-4389-b963-f7f1bf418660'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:37.690175 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] The token cache is being invalidate because project a4e0259498c3465dab180fc2907b2d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:37.690901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:37.691233 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:37.692779 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1459/2879] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:37 2022] DELETE /identity/v3/projects/a4e0259498c3465dab180fc2907b2d26 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:37.697983 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:37.709533 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d494b-ad6c-4d46-b1d4-f369cd4b4ac9 service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:37.770304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:37.770975 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:37.771231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:37.771511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] PATH_INFO: `/v3/users/45bd872f1f344ec9b5f2214956cd1ce4` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:37.772714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bd872f1f344ec9b5f2214956cd1ce4)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:37.774643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:38.046084 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bd872f1f344ec9b5f2214956cd1ce4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.139378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bd872f1f344ec9b5f2214956cd1ce4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.141731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bd872f1f344ec9b5f2214956cd1ce4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.141731 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:38.148612 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bd872f1f344ec9b5f2214956cd1ce4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.161721 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-c5cfd580-20c9-4a61-824a-80dee471319c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bd872f1f344ec9b5f2214956cd1ce4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.167710 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1421/2880] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:37 2022] DELETE /identity/v3/users/45bd872f1f344ec9b5f2214956cd1ce4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:38.729003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:38.730506 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:38.745913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6e88c-9dee-4389-b963-f7f1bf418660 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:38.810823 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:38.811470 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:38.811756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:38.812057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] PATH_INFO: `/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:38.813243 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a92a8bf1f84baa8d167e2950f4ecfd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:38.815606 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:38.956621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a92a8bf1f84baa8d167e2950f4ecfd', 'request_id': 'req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.041171 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a92a8bf1f84baa8d167e2950f4ecfd', 'request_id': 'req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.049928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a92a8bf1f84baa8d167e2950f4ecfd', 'request_id': 'req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.063124 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] The token cache is being invalidate because project 95a92a8bf1f84baa8d167e2950f4ecfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:39.063409 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.064064 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2aa4a9d5-7068-49fe-9812-87ad8d210ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.065818 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1460/2881] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:38 2022] DELETE /identity/v3/projects/95a92a8bf1f84baa8d167e2950f4ecfd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:39.071123 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.071549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.071714 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.092739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:39.093966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:39.162082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1422/2882] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:39.170751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.171070 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.171352 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.192005 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:39.193239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:39.202197 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1461/2883] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:39.207362 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.218648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264aad9-b590-45fb-989a-2924068b7cb0 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.223567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.224183 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.224472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.224777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.225433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:39.225746 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.227461 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.240730 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1423/2884] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:39.245322 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.254954 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90386-efe5-4cd2-aeb5-5256652fe6c4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.259809 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.260416 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.260734 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.261008 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.262198 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.263736 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.386587 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1462/2885] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:39.395879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.407387 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460d80-62c0-4879-8d80-f0af09bd4b5f admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.486386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.487003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.487284 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.487559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.488192 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.490166 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.609149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1424/2886] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:39.614018 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.626244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100f80-a1c7-45a1-98a7-2e9116c098a7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.631833 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.632520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.632816 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.633104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.633751 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.635344 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.647340 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1463/2887] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:39.651621 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.662986 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb05a05-b624-4fa1-8895-50d9d9bb1007 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.667891 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.668528 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.668849 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.669130 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.669978 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.671580 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8103b32-cfdb-4cd2-b36d-e6600254145d admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.682723 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1425/2888] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:39.687318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.697490 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfa426-4dc7-452f-b97f-6a309cf4bd06 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.702849 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.703514 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.703800 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.704082 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] PATH_INFO: `/v3/projects/652beda9746745cdb8b18e38abe77c03/users/7d874b82b67a421ba006b23da214e285/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.720492 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652beda9746745cdb8b18e38abe77c03, user_id=7d874b82b67a421ba006b23da214e285, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.723181 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.802443 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1464/2889] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:39 2022] PUT /identity/v3/projects/652beda9746745cdb8b18e38abe77c03/users/7d874b82b67a421ba006b23da214e285/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:39.814410 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.814695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.815450 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.846717 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] MFA Rules not processed for user `7d874b82b67a421ba006b23da214e285`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:39.847952 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:39.876028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:39.918238 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1426/2890] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:39.924260 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.939928 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:39.999410 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b727137-b296-4d9b-8399-53b27e72c464 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.004860 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.005499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.006429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.006713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.007364 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.009906 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.156137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1465/2891] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:39 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:40.160434 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.171463 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613192-0cfd-45fd-9ad0-4b8e986c019b None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.241079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.241696 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.241980 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.242258 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.242920 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.244989 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.345550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1427/2892] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:40 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:40.350143 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.362348 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70128c5-52b1-4686-97b6-bb4e7d030add admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.367126 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.367741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.368047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.368325 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.369003 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.370604 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.383172 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1466/2893] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:40.387509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.397987 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46de8-9d56-4c5c-bb81-5c4966ade37a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.403326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.404041 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.404326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.404628 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] PATH_INFO: `/v3/projects/7e87f03999d0448eb5175f0b69080437/users/8907085b583d40738e0e8585c5f3a081/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.422884 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e87f03999d0448eb5175f0b69080437, user_id=8907085b583d40738e0e8585c5f3a081, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.425645 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.511119 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1428/2894] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:40 2022] PUT /identity/v3/projects/7e87f03999d0448eb5175f0b69080437/users/8907085b583d40738e0e8585c5f3a081/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:40.517252 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.528099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a61342-270f-4e51-9fbf-a53fc3c1b2ba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.600099 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.601313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.601313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.601313 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.601965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.603569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164fe82-ace8-4339-9ecb-cd48e71eb338 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.615283 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1467/2895] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:40.619955 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.633750 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752119-af1d-4e72-be45-786d0da7974c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.638861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.639484 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.639836 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.640070 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] PATH_INFO: `/v3/projects/7e87f03999d0448eb5175f0b69080437/users/8907085b583d40738e0e8585c5f3a081/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.642003 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e87f03999d0448eb5175f0b69080437, user_id=8907085b583d40738e0e8585c5f3a081, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.645185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.657016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1429/2896] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:40 2022] PUT /identity/v3/projects/7e87f03999d0448eb5175f0b69080437/users/8907085b583d40738e0e8585c5f3a081/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:40.667371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.667593 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.667869 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.696950 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] MFA Rules not processed for user `8907085b583d40738e0e8585c5f3a081`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:40.698182 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:40.778493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1468/2897] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:40.791190 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.793016 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:40.854602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a4f61-3f6a-428b-b064-e6d15a8eb38c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.859861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.860471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.860783 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.861056 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.871308 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.874006 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.884934 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1430/2898] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:41.275798 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:41.282499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:41.286569 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdde85-6c09-4dd7-ad95-fc31b9832fea None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:41.292001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:41.292001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:41.292001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:41.292001 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:41.354047 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:41.355521 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:41.365078 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1469/2899] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:49.231118 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:49.232673 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:49.260581 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:49.301157 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a4af-3af2-4ecf-a2fc-dd9ffedcfa5d service cinder] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:49.305882 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:49.306527 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:49.306810 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:49.307089 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] PATH_INFO: `/v3/users/6d46e2bd6c7f4d449d9bbd38066e0769` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:49.308231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d46e2bd6c7f4d449d9bbd38066e0769)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:49.310259 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:49.545869 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d46e2bd6c7f4d449d9bbd38066e0769'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:49.636019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d46e2bd6c7f4d449d9bbd38066e0769'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:49.636749 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d46e2bd6c7f4d449d9bbd38066e0769'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:49.645611 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d46e2bd6c7f4d449d9bbd38066e0769'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:49.660351 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d46e2bd6c7f4d449d9bbd38066e0769'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:49.666505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1431/2900] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:49 2022] DELETE /identity/v3/users/6d46e2bd6c7f4d449d9bbd38066e0769 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:49.801435 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:49.813596 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e14b-703f-46bc-a466-bcc7c3986629 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:49.879376 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:49.879943 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:49.880244 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:49.880503 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] PATH_INFO: `/v3/users/7d874b82b67a421ba006b23da214e285` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:49.881761 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d874b82b67a421ba006b23da214e285)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:49.883805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:49.985509 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:49.991600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.003768 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6df6-99db-4cf9-8c75-961df1bb2026 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.008646 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.009305 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.009585 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.009861 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] PATH_INFO: `/v3/projects/8b3a64318e4d4f9983ec2ff12ad7088f` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.011023 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3a64318e4d4f9983ec2ff12ad7088f)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.013929 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.125704 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d874b82b67a421ba006b23da214e285'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.196057 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d874b82b67a421ba006b23da214e285'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.196721 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d874b82b67a421ba006b23da214e285'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.212207 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d874b82b67a421ba006b23da214e285'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.216846 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3a64318e4d4f9983ec2ff12ad7088f', 'request_id': 'req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.221889 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-28baa9c3-20b0-462c-a106-492a7b4c4cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d874b82b67a421ba006b23da214e285'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.228805 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1470/2901] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:49 2022] DELETE /identity/v3/users/7d874b82b67a421ba006b23da214e285 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:50.234110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.234110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.234110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.253280 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:50.254517 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.273462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:50.319037 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1471/2902] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:50.329839 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.331465 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.378652 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3a64318e4d4f9983ec2ff12ad7088f', 'request_id': 'req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.385326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3a64318e4d4f9983ec2ff12ad7088f', 'request_id': 'req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.387945 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36772-ac55-4a7d-9bde-b234101c9eef None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.392319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.392958 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.393257 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.393522 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.398313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] The token cache is being invalidate because project 8b3a64318e4d4f9983ec2ff12ad7088f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:50.398608 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.399255 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-78f775ec-cc04-4ede-ab9b-ad3b81acbcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:50.401101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1432/2903] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:49 2022] DELETE /identity/v3/projects/8b3a64318e4d4f9983ec2ff12ad7088f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:50.403650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.405493 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a3bdd-0f08-4cc8-b6ad-73413baa8873 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.405694 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.406021 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.406383 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.417585 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1472/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:50.426906 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:50.428162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.439897 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1433/2905] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:50.454508 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.454831 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.455104 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.476778 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:50.478036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.487576 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1473/2906] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:50.492202 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.503082 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31ef00-c71c-4f16-9825-7795873f331d None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.507957 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.508866 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.509027 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.509311 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.510098 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:50.510506 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.512648 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.527149 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1434/2907] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:50.532421 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.542866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bc97b-cdc3-42c3-ac2f-542121fc9d8b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.549075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.549924 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.550483 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.550834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.551768 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.554614 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.654806 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1474/2908] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:50 2022] POST /identity/v3/projects => generated 397 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:50.659185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.666885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:50.673543 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c7cf-d171-4be4-90df-c2dfb4d0fbce admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.741772 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.742153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.742153 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.742452 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.743095 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.745135 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.886152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1435/2909] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:50 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:50.890601 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.901885 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461e742-cbb4-428a-9444-a0b50fb824c7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.907249 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.907866 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.908187 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.908462 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.909148 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.910743 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.925073 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1475/2910] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:50.928871 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.930792 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:50.931756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.943247 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55144d-43e6-4b0c-9c5a-bf1c70bad677 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.949682 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.950320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.950626 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.950898 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.952380 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.955116 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.957033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66164-e5a7-43d4-91bc-7eb308a06bd6 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.962209 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.963045 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.963423 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.963798 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] PATH_INFO: `/v3/projects/652beda9746745cdb8b18e38abe77c03` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:50.965253 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=652beda9746745cdb8b18e38abe77c03)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:50.967051 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1476/2911] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:21:50.971164 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:50.971834 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:50.982270 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db02b-3e64-4a22-add4-49ada2a4bbff admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:50.988739 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:50.989448 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:50.989695 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:50.989971 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] PATH_INFO: `/v3/projects/1d1816dc50cd4ce29aab2dd5884aab6e/users/b8e9b9de2efe438f8e311ff61727d8b1/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:51.007830 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1816dc50cd4ce29aab2dd5884aab6e, user_id=b8e9b9de2efe438f8e311ff61727d8b1, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:51.013216 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56428cef-14c1-4ed5-a907-a6e7f8b54096 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:51.107929 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1477/2912] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:50 2022] PUT /identity/v3/projects/1d1816dc50cd4ce29aab2dd5884aab6e/users/b8e9b9de2efe438f8e311ff61727d8b1/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:51.126103 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098167f3-341e-470b-8d17-e0da2103890c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:51.126512 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098167f3-341e-470b-8d17-e0da2103890c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:51.126670 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652beda9746745cdb8b18e38abe77c03', 'request_id': 'req-9f736e4f-6ec4-434e-bd19-56db124a02cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.126918 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098167f3-341e-470b-8d17-e0da2103890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:51.161139 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-098167f3-341e-470b-8d17-e0da2103890c None None] MFA Rules not processed for user `b8e9b9de2efe438f8e311ff61727d8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:51.162400 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-098167f3-341e-470b-8d17-e0da2103890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:51.208747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:51.219428 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652beda9746745cdb8b18e38abe77c03', 'request_id': 'req-9f736e4f-6ec4-434e-bd19-56db124a02cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.229028 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652beda9746745cdb8b18e38abe77c03', 'request_id': 'req-9f736e4f-6ec4-434e-bd19-56db124a02cc'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.244444 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] The token cache is being invalidate because project 652beda9746745cdb8b18e38abe77c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81765) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:51.244747 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1478/2913] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:21:51.245012 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.245665 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.248167 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1436/2914] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:50 2022] DELETE /identity/v3/projects/652beda9746745cdb8b18e38abe77c03 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:51.252739 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:51.255690 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:51.263515 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098167f3-341e-470b-8d17-e0da2103890c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:51.265290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-098167f3-341e-470b-8d17-e0da2103890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:51.338218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f736e4f-6ec4-434e-bd19-56db124a02cc admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:51.345365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:51.346060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:51.346515 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:51.346777 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] PATH_INFO: `/v3/users/8907085b583d40738e0e8585c5f3a081` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:51.348100 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8907085b583d40738e0e8585c5f3a081)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:51.349999 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098167f3-341e-470b-8d17-e0da2103890c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:51.350212 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:51.359218 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cdf8633c7740629b6956f631959f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:51.361159 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:51.361551 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:51.361979 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:51.364390 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:51.377429 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:51.383338 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:51.386135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:51.404214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1479/2915] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:51.643748 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8907085b583d40738e0e8585c5f3a081'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.754668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8907085b583d40738e0e8585c5f3a081'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.755365 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8907085b583d40738e0e8585c5f3a081'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.769992 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8907085b583d40738e0e8585c5f3a081'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.785378 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-8a337bbe-8e3e-40a5-bb91-79d8dcbb759c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8907085b583d40738e0e8585c5f3a081'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:51.792216 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1437/2916] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:51 2022] DELETE /identity/v3/users/8907085b583d40738e0e8585c5f3a081 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:21:52.389156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:52.416396 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e64640-b80f-4949-bb75-97485df747cf service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:52.500545 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:52.501910 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:52.502192 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:52.502467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] PATH_INFO: `/v3/projects/7e87f03999d0448eb5175f0b69080437` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:52.503683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e87f03999d0448eb5175f0b69080437)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:52.505685 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:52.631955 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e87f03999d0448eb5175f0b69080437', 'request_id': 'req-721bca8a-f85a-48ac-a147-b407d7bd534f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:52.750140 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e87f03999d0448eb5175f0b69080437', 'request_id': 'req-721bca8a-f85a-48ac-a147-b407d7bd534f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:52.759719 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e87f03999d0448eb5175f0b69080437', 'request_id': 'req-721bca8a-f85a-48ac-a147-b407d7bd534f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:52.774766 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] The token cache is being invalidate because project 7e87f03999d0448eb5175f0b69080437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:52.775135 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:52.775870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-721bca8a-f85a-48ac-a147-b407d7bd534f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:52.778320 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1480/2917] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:52 2022] DELETE /identity/v3/projects/7e87f03999d0448eb5175f0b69080437 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:52.785159 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:52.785766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:52.785766 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:52.808972 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:52.810217 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:52.879437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1438/2918] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:52.888901 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:52.889111 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:52.889362 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:52.912115 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:52.913418 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:52.921358 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1481/2919] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:52.926698 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:52.937263 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b89e-6b28-49f8-af19-d6d526e680b5 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:52.942597 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:52.943236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:52.943517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:52.943796 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] PATH_INFO: `/v3/domains` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:52.944471 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81765) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:21:52.944813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:52.946567 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:52.960893 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1439/2920] 10.222.0.33 () {58 vars in 1153 bytes} [Thu Sep 8 14:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:21:52.969713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:52.979431 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb669-2ad9-44b4-be79-7ad5db42fa44 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:52.984226 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:52.984915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:52.984915 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:52.985556 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:52.986071 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:52.988036 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:52.993025 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:53.192007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1482/2921] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:53.196596 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:53.209988 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4af42-ff72-4ff5-80cf-a3b0953e273c admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:53.276602 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:53.277236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.277525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.277826 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.278478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:53.280913 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:53.492437 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1440/2922] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:21:53 2022] POST /identity/v3/users => generated 292 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:21:53.492602 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:53.503985 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a2ad-76a2-4263-907b-87afaf498e64 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:53.508871 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:53.515220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.515220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.515220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.515220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:53.515220 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:53.524075 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1483/2923] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:21:53.528505 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:53.540399 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89801fa6-56fd-4adf-ba8f-ca620781314a admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:53.545348 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:53.545963 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.546244 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.546522 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.547373 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:53.549083 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a78154-a5a0-4f23-8ad3-d2d3a60dfa02 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:53.562078 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1441/2924] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:21:53.567713 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:53.581007 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce935df-a843-4120-91f4-5b68fc41cf77 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:53.585912 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:53.586635 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.586878 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.587156 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] PATH_INFO: `/v3/projects/3c11111db1e4493a8d086b0f7eb8f509/users/ce89de97b4f843869c342b6b2fc3393d/roles/f500e18e097649cf98678fa3334fb969` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.603948 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c11111db1e4493a8d086b0f7eb8f509, user_id=ce89de97b4f843869c342b6b2fc3393d, role_id=f500e18e097649cf98678fa3334fb969)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:53.606639 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:53.761937 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1484/2925] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:21:53 2022] PUT /identity/v3/projects/3c11111db1e4493a8d086b0f7eb8f509/users/ce89de97b4f843869c342b6b2fc3393d/roles/f500e18e097649cf98678fa3334fb969 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:53.767940 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.768234 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.769661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.780360 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:53.793060 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:53.794304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:53.866043 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1442/2926] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:53.877319 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:53.879150 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:53.946430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998cf0c-1cce-4200-ae51-3505c4456c1c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:53.950773 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:53.951406 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:53.951683 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:53.951957 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:53.962236 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:53.963786 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847f62f-faa5-4f08-ba6c-31512fbee3f7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:53.974397 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1485/2927] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:58.311033 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:58.312951 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:58.326666 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215bb0-c988-4105-89c4-26740c83f833 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:58.335828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:58.336964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:58.337541 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:58.337813 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] PATH_INFO: `/v3/users/b8e9b9de2efe438f8e311ff61727d8b1` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:58.339821 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e9b9de2efe438f8e311ff61727d8b1)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:58.343048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:58.645208 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e9b9de2efe438f8e311ff61727d8b1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:58.768236 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e9b9de2efe438f8e311ff61727d8b1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:58.770467 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e9b9de2efe438f8e311ff61727d8b1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:58.779472 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e9b9de2efe438f8e311ff61727d8b1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:58.795304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e9b9de2efe438f8e311ff61727d8b1'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:58.803433 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1443/2928] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:58 2022] DELETE /identity/v3/users/b8e9b9de2efe438f8e311ff61727d8b1 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:58.808582 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:58.812563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:58.812563 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:58.845271 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] MFA Rules not processed for user `1ba15123fbd2428d82b676fd494c4a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:21:58.846539 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:58.977913 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1486/2929] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:21:58.990517 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:58.992486 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:59.134112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f3269-5153-48cf-94b3-d3cd20e06eb4 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:59.134112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:59.134112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:59.134112 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:59.134511 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:59.144840 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:59.146306 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93269c3c-e9d8-4822-ab24-79eb9f3b3818 service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:59.157456 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1444/2930] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:59.703782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:59.711373 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:59.740643 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b39f4-f265-4a5c-a8c3-c78769109098 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:59.759611 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:59.761239 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:59.761741 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:59.762310 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] PATH_INFO: `/v3/projects/1d1816dc50cd4ce29aab2dd5884aab6e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:59.764819 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1816dc50cd4ce29aab2dd5884aab6e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:59.770972 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:59.970043 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:59.972113 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1816dc50cd4ce29aab2dd5884aab6e', 'request_id': 'req-ba2da1cd-8745-4977-a291-2bd3065d2a25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:00.080234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1816dc50cd4ce29aab2dd5884aab6e', 'request_id': 'req-ba2da1cd-8745-4977-a291-2bd3065d2a25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:00.089783 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1816dc50cd4ce29aab2dd5884aab6e', 'request_id': 'req-ba2da1cd-8745-4977-a291-2bd3065d2a25'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:00.093386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:00.093386 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:00.096162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:00.108039 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] The token cache is being invalidate because project 1d1816dc50cd4ce29aab2dd5884aab6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:00.108630 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:00.110020 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:00.112385 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1487/2931] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:59 2022] DELETE /identity/v3/projects/1d1816dc50cd4ce29aab2dd5884aab6e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:00.132169 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] MFA Rules not processed for user `ce89de97b4f843869c342b6b2fc3393d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:00.133973 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:00.140107 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:00.221243 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1445/2932] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:00.247058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:00.247058 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:00.350108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da1cd-8745-4977-a291-2bd3065d2a25 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:00.356022 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:00.356940 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:00.357332 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:00.357742 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:00.359438 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:00.361650 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:00.542790 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1488/2933] 10.222.0.33 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:00 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:00.547729 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:00.559380 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7568b-32ed-47b5-b3b7-428419dedd3e None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:00.621133 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:00.621763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:00.622039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:00.622312 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:00.623020 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:00.625686 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:00.716751 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1446/2934] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:00 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:00.721137 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:00.731953 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b839d-3dfd-4f8f-a55a-42d247a6deee admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:00.738567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:00.742649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:00.742649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:00.742649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:00.742649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:00.742649 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:00.754011 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1489/2935] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:00.758427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:00.769576 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900502f-76d2-4cca-806e-4b5c867397c0 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:00.774501 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:00.775163 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:00.775591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:00.775872 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] PATH_INFO: `/v3/projects/1c946a1a6b234796bee17219a62f8255/users/6ceb43bde0a646e487943e1ec816ca55/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:00.792061 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c946a1a6b234796bee17219a62f8255, user_id=6ceb43bde0a646e487943e1ec816ca55, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:00.794879 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:00.910767 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1447/2936] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:00 2022] PUT /identity/v3/projects/1c946a1a6b234796bee17219a62f8255/users/6ceb43bde0a646e487943e1ec816ca55/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:00.912574 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:00.933318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72746f55-4316-49ab-ac57-c18740462ba6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:01.017298 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:01.018312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:01.018312 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:01.018624 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:01.019048 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:01.021837 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1e94d-c1a4-4d4d-bf42-af69b91bedba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:01.034234 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1490/2937] 10.222.0.33 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:01.038903 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:01.051421 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21717c3b-5f61-46f7-9a9a-1656cbe6c591 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:01.056325 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935e53-245a-4605-8032-6056784df046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:01.057058 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935e53-245a-4605-8032-6056784df046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:01.057342 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935e53-245a-4605-8032-6056784df046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:01.057635 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67935e53-245a-4605-8032-6056784df046 admin admin] PATH_INFO: `/v3/projects/1c946a1a6b234796bee17219a62f8255/users/6ceb43bde0a646e487943e1ec816ca55/roles/7344c45181b34c769b527731ca22627a` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:01.059641 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935e53-245a-4605-8032-6056784df046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c946a1a6b234796bee17219a62f8255, user_id=6ceb43bde0a646e487943e1ec816ca55, role_id=7344c45181b34c769b527731ca22627a)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:01.062455 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67935e53-245a-4605-8032-6056784df046 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:01.075885 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1448/2938] 10.222.0.33 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:01 2022] PUT /identity/v3/projects/1c946a1a6b234796bee17219a62f8255/users/6ceb43bde0a646e487943e1ec816ca55/roles/7344c45181b34c769b527731ca22627a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:08.554467 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ec6b-e00b-4f33-8994-fefa66ca1afa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:08.555040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ec6b-e00b-4f33-8994-fefa66ca1afa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:08.555040 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ec6b-e00b-4f33-8994-fefa66ca1afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:08.593326 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-30e9ec6b-e00b-4f33-8994-fefa66ca1afa None None] MFA Rules not processed for user `6ceb43bde0a646e487943e1ec816ca55`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:08.596215 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-30e9ec6b-e00b-4f33-8994-fefa66ca1afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:08.639655 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:08.679900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1491/2939] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:08.693693 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935e53-245a-4605-8032-6056784df046 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:08.705828 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-67935e53-245a-4605-8032-6056784df046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:08.780556 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:08.799562 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67935e53-245a-4605-8032-6056784df046 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:08.803618 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1ae9fed0454cb390554e3ad0ef580e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:08.804322 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:08.804649 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:08.804931 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:08.878427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:08.880068 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:08.889894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1449/2940] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:09.202679 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa5ae-d485-434e-b720-af2820e4c0df None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:09.203657 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa5ae-d485-434e-b720-af2820e4c0df None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:09.204567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa5ae-d485-434e-b720-af2820e4c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:09.225274 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0c1aa5ae-d485-434e-b720-af2820e4c0df None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:09.226520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c1aa5ae-d485-434e-b720-af2820e4c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:09.298321 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1492/2941] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:22:09.486193 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:09.487643 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:09.595695 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248e06-9857-43b0-85de-3ae1da94ba0a service glance] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:09.601101 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:09.601745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:09.602152 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:09.602329 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:09.614805 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:09.617271 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd142f-a531-4ec9-9bce-d1708a40228c service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:09.629967 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1450/2942] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:22:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:22:19.290284 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=38 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:19.623878 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=67 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:20.685621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:20.686214 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:20.686608 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:20.711667 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] MFA Rules not processed for user `ce89de97b4f843869c342b6b2fc3393d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:20.712965 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:20.721318 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1493/2943] 10.222.0.33 () {58 vars in 958 bytes} [Thu Sep 8 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:25.285902 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] REQUEST_METHOD: `POST` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:25.286591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:25.286591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:25.309224 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.auth.core [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81765) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:25.310639 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:25.319302 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1451/2944] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Sep 8 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:25.335687 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:25.350586 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b007e2-1670-433e-b86e-6a18e78a3f52 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:25.356566 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:25.357235 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:25.357510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:25.357782 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:25.373426 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:25.376771 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:25.387692 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1494/2945] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:22:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:22:35.303578 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=3 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:35.382629 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=9 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:49.176079 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:49.178661 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:49.236162 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebc9f9-2fc7-46b8-96b0-4da2254e0e34 None None] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:49.239841 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8d65bfd6aed4083a04c5dc277cfb85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:49.240451 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:49.240763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:49.241039 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.250782 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:49.252218 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:49.261778 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1452/2946] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:51.615445 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.617371 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:51.697456 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3bdff-f78f-4a19-9a4a-a7428b340e15 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.703579 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '171bca600dcb4dcba12c02fb3dc67197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.704304 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.704633 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.704884 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.706722 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:51.721225 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.729826 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076396-6a88-4a95-a4c0-6a4ea67ca36f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.736110 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1495/2947] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:59.257485 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=26 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:01.731130 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=34 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:47.915706 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:23:47.917818 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:23:47.993525 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f621e9-7a86-4e9c-98fb-bb5ad591e76b service neutron] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:23:47.998873 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:23:47.999495 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:23:47.999773 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:23:48.000745 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:23:48.003231 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:23:48.016407 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:23:48.018114 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:23:48.029339 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1453/2948] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:23:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:23:58.024493 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=32 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:24:19.430420 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:19.430996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:19.430996 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:19.453151 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] MFA Rules not processed for user `b0c4bdc0bd494a61b889dc79354b3f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:24:19.454405 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:24:19.463017 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1496/2949] 10.222.0.33 () {58 vars in 967 bytes} [Thu Sep 8 14:24:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:24:19.509894 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:19.525591 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a549e4-6483-4abd-b833-e0195a3b627a service placement] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:19.531185 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b60fd9fbd81e403e8b22b8204eb92dfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:19.531966 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:19.532304 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:19.532735 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:19.542668 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:19.544269 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:19.553763 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1454/2950] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Sep 8 14:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:24:24.355258 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:24.376567 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c4376-0563-453d-9743-9e216e756ad1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:24.385266 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:24.386250 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:24.386681 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:24.387101 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:24.389812 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:24:24.405407 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:24.407900 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:24.422568 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1497/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:24:28.772427 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:28.839145 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9011a6-a630-464f-9213-067ecaa511c6 service swift] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:28.843600 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:28.844226 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:28.844504 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:28.844803 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] PATH_INFO: `/v3/users/ce89de97b4f843869c342b6b2fc3393d` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:28.845919 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce89de97b4f843869c342b6b2fc3393d)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:28.847833 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:29.077254 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce89de97b4f843869c342b6b2fc3393d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.154265 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce89de97b4f843869c342b6b2fc3393d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.154895 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce89de97b4f843869c342b6b2fc3393d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.162982 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce89de97b4f843869c342b6b2fc3393d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.175551 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce89de97b4f843869c342b6b2fc3393d'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.182275 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1455/2952] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:24:28 2022] DELETE /identity/v3/users/ce89de97b4f843869c342b6b2fc3393d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:24:29.464411 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:29.477944 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fd06f-1f93-4cf2-87d9-3e3cc4c7e46d service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:29.539108 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:29.539848 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:29.540158 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:29.540430 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] PATH_INFO: `/v3/projects/3c11111db1e4493a8d086b0f7eb8f509` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:29.541609 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c11111db1e4493a8d086b0f7eb8f509)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:29.543499 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:29.650264 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c11111db1e4493a8d086b0f7eb8f509', 'request_id': 'req-b3ffff66-e867-4f59-be07-83d81fbcb6fd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.708429 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c11111db1e4493a8d086b0f7eb8f509', 'request_id': 'req-b3ffff66-e867-4f59-be07-83d81fbcb6fd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.715873 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c11111db1e4493a8d086b0f7eb8f509', 'request_id': 'req-b3ffff66-e867-4f59-be07-83d81fbcb6fd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.728434 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] The token cache is being invalidate because project 3c11111db1e4493a8d086b0f7eb8f509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:24:29.728756 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.729439 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:29.730926 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1498/2953] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:24:29 2022] DELETE /identity/v3/projects/3c11111db1e4493a8d086b0f7eb8f509 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:24:29.734956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:29.736369 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:24:29.750257 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cd6b-b6c5-4df6-aace-6e8f31fe0fb5 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:29.808638 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:29.809321 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:29.809559 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:29.809824 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] PATH_INFO: `/v3/users/6ceb43bde0a646e487943e1ec816ca55` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:29.810964 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ceb43bde0a646e487943e1ec816ca55)` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:29.812956 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:29.818905 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:24:30.067549 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ceb43bde0a646e487943e1ec816ca55'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.165727 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ceb43bde0a646e487943e1ec816ca55'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.166358 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ceb43bde0a646e487943e1ec816ca55'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.174672 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ceb43bde0a646e487943e1ec816ca55'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.189307 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.notifications [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ceb43bde0a646e487943e1ec816ca55'} {{(pid=81765) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.197063 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1456/2954] 10.222.0.33 () {58 vars in 1224 bytes} [Thu Sep 8 14:24:29 2022] DELETE /identity/v3/users/6ceb43bde0a646e487943e1ec816ca55 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:24:30.447993 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:24:30.449500 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:24:30.463664 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffff66-e867-4f59-be07-83d81fbcb6fd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:24:30.525191 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ba15123fbd2428d82b676fd494c4a7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61119233e1da4995af8ba7ce35ded1dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:24:30.526062 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:24:30.526183 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:24:30.526440 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] PATH_INFO: `/v3/projects/1c946a1a6b234796bee17219a62f8255` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:24:30.527578 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c946a1a6b234796bee17219a62f8255)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:24:30.529510 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:24:30.541290 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:24:30.613870 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c946a1a6b234796bee17219a62f8255', 'request_id': 'req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.663190 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c946a1a6b234796bee17219a62f8255', 'request_id': 'req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.670621 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c946a1a6b234796bee17219a62f8255', 'request_id': 'req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.685530 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] The token cache is being invalidate because project 1c946a1a6b234796bee17219a62f8255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:24:30.685822 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.686520 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-07f2313c-bf4a-4c39-b56e-cf1d5bb9263c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:24:30.688208 dv-cinder-820027-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1499/2955] 10.222.0.33 () {58 vars in 1233 bytes} [Thu Sep 8 14:24:30 2022] DELETE /identity/v3/projects/1c946a1a6b234796bee17219a62f8255 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:24:40.192478 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:24:40.681652 dv-cinder-820027-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:28:51.817132 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Authenticating user token {{(pid=81765) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:28:51.818550 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:28:51.967066 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9007e-5f09-41ac-add3-9c895f5fdb87 admin admin] Validating token access rules against request {{(pid=81765) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:28:52.032313 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc702da0b654042a0f5526ea47ef536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b915d9f6e106444188d392ed85ce3f23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81765) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:28:52.032991 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] REQUEST_METHOD: `GET` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:28:52.033273 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] SCRIPT_NAME: `/identity` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:28:52.033544 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81765) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:28:52.035326 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.fernet_utils [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81765) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:28:52.048215 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:28:52.049848 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3127f0-0b79-40cf-8b24-376e58a59c6d service placement] RBAC: Authorization granted {{(pid=81765) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:28:52.061019 dv-cinder-820027-24-smb devstack@keystone.service[81765]: [pid: 81765|app: 0|req: 1457/2956] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Sep 8 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:29:02.056048 dv-cinder-820027-24-smb devstack@keystone.service[81765]: DEBUG dbcounter [-] [81765] Writing DB stats keystone:SELECT=89 {{(pid=81765) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}